[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:32 dist-test-slave-fgb3 krb5kdc[4352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:32 dist-test-slave-fgb3 krb5kdc[4352](info): set up 2 sockets
Aug 08 18:38:32 dist-test-slave-fgb3 krb5kdc[4352](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 18:38:33.165138 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:33.291467 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34961
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:34961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:33.406941 4374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:33.407251 4374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:33.407300 4374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:33.411273 4374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:33.411343 4374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:33.411361 4374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:33.411379 4374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:33.411396 4374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:33.416694 4374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:34961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:33.417737 4374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:33.418785 4374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:33.428237 4384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:33.428252 4382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:33.428524 4381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:33.428718 4374 server_base.cc:1034] running on GCE node
I20260808 18:38:33.429219 4374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:33.430225 4374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:33.431375 4374 hybrid_clock.cc:648] HybridClock initialized: now 1786214313431335 us; error 49 us; skew 500 ppm
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:33.433864 4374 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:33.434796 4374 webserver.cc:460] Webserver started at http://127.4.61.254:43605/ using document root <none> and password file <none>
I20260808 18:38:33.435279 4374 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:33.435345 4374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:33.435509 4374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:33.437794 4374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "655ea8189b684691a932e7a71a452c45"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "60c6f3e6f3b61402e397fc3702b7c3e8"
server_key_iv: "636aa79a7a0d9b6c6b872a4db6c40bd4"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.438531 4374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "655ea8189b684691a932e7a71a452c45"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "60c6f3e6f3b61402e397fc3702b7c3e8"
server_key_iv: "636aa79a7a0d9b6c6b872a4db6c40bd4"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.442133 4374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:38:33.444504 4391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.445820 4374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:33.445941 4374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "655ea8189b684691a932e7a71a452c45"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "60c6f3e6f3b61402e397fc3702b7c3e8"
server_key_iv: "636aa79a7a0d9b6c6b872a4db6c40bd4"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.446100 4374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:33.460325 4374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:33.463158 4374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:33.463351 4374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:33.473847 4374 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:34961
I20260808 18:38:33.473839 4479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:34961 every 8 connection(s)
I20260808 18:38:33.474925 4374 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:33.478005 4480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:33.478737 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4374
I20260808 18:38:33.478892 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:33.480199 4343 external_mini_cluster.cc:1428] Setting key 4aecd9ccd99c3e28c9bdd61d289de9c2
I20260808 18:38:33.484474 4480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45: Bootstrap starting.
I20260808 18:38:33.486840 4480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:33.487591 4480 log.cc:824] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:33.489830 4480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45: No bootstrap required, opened a new log
I20260808 18:38:33.494154 4480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } }
I20260808 18:38:33.494422 4480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:33.494485 4480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 655ea8189b684691a932e7a71a452c45, State: Initialized, Role: FOLLOWER
I20260808 18:38:33.495046 4480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } }
I20260808 18:38:33.495218 4480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:33.495294 4480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:33.495404 4480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:33.496348 4480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } }
I20260808 18:38:33.496766 4480 leader_election.cc:302] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 655ea8189b684691a932e7a71a452c45; no voters:
I20260808 18:38:33.497118 4480 leader_election.cc:288] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:33.497251 4488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:33.497500 4488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [term 1 LEADER]: Becoming Leader. State: Replica: 655ea8189b684691a932e7a71a452c45, State: Running, Role: LEADER
I20260808 18:38:33.497884 4488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } }
I20260808 18:38:33.498679 4480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:33.499914 4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "655ea8189b684691a932e7a71a452c45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } } }
I20260808 18:38:33.500047 4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:33.500375 4490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 655ea8189b684691a932e7a71a452c45. Latest consensus state: current_term: 1 leader_uuid: "655ea8189b684691a932e7a71a452c45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655ea8189b684691a932e7a71a452c45" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34961 } } }
I20260808 18:38:33.500519 4490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:33.500837 4496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:33.504951 4496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:33.506172 4482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:33.483573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36762 (local address 127.4.61.254:34961)
0808 18:38:33.484177 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:33.484198 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:33.485277 (+ 1079us) server_negotiation.cc:407] Connection header received
0808 18:38:33.488603 (+ 3326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:33.488625 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:33.489014 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:33.489363 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:33.491717 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.493305 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.494672 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.495441 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.495655 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:33.500120 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:33.500128 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:33.500145 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:33.500178 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:33.502356 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.502988 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.502994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.503000 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.503137 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.503539 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.503543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.503544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.504093 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:33.504284 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:33.504953 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 18:38:33.505240 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":169,"threads_started":1}
I20260808 18:38:33.511762 4496 catalog_manager.cc:1347] Generated new cluster ID: d8a71425bd7246288aed8adf6b89c2a7
I20260808 18:38:33.511826 4496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:33.520555 4496 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:33.521400 4496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:33.528385 4496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 655ea8189b684691a932e7a71a452c45: Generated new TSK 0
I20260808 18:38:33.529138 4496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:33.569455 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:33.682597 4517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:33.682844 4517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:33.682886 4517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:33.686985 4517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:33.687048 4517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:33.687111 4517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:33.692291 4517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:33.693316 4517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:33.694473 4517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:33.704205 4528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:33.704213 4527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:33.705878 4517 server_base.cc:1034] running on GCE node
W20260808 18:38:33.705940 4530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:33.706362 4517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:33.707024 4517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:33.708206 4517 hybrid_clock.cc:648] HybridClock initialized: now 1786214313708175 us; error 39 us; skew 500 ppm
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:33.710958 4517 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:33.711897 4517 webserver.cc:460] Webserver started at http://127.4.61.193:43231/ using document root <none> and password file <none>
I20260808 18:38:33.712436 4517 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:33.712493 4517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:33.712669 4517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:33.714867 4517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "1d814d96c506442aa8da7709d7c65dcd"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "ea8dcafd488942fb4a2e4c20acea486c"
server_key_iv: "e9321a969ae18c8eb4d4952b85a832cf"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.715567 4517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "1d814d96c506442aa8da7709d7c65dcd"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "ea8dcafd488942fb4a2e4c20acea486c"
server_key_iv: "e9321a969ae18c8eb4d4952b85a832cf"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.719528 4517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:38:33.721931 4539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.723162 4517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:33.723272 4517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "1d814d96c506442aa8da7709d7c65dcd"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "ea8dcafd488942fb4a2e4c20acea486c"
server_key_iv: "e9321a969ae18c8eb4d4952b85a832cf"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.723368 4517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:33.732879 4517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:33.735623 4517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:33.735803 4517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:33.736369 4517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:33.737218 4517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:33.737273 4517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.737326 4517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:33.737355 4517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.754060 4517 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:43723
I20260808 18:38:33.754077 4716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:43723 every 8 connection(s)
I20260808 18:38:33.755091 4517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:33.757344 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4517
I20260808 18:38:33.757453 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:33.757699 4343 external_mini_cluster.cc:1428] Setting key c0a7e0d762a368d16004660a86c06246
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:33.770582 4482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:33.757267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:48225 (local address 127.4.61.254:34961)
0808 18:38:33.757446 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:33.757451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:33.758482 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 18:38:33.760235 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:33.760238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:33.760291 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:33.760368 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:33.761993 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.762627 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.764004 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.764362 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.764477 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:33.767049 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:33.767054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:33.767073 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:33.767108 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:33.768592 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.769064 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.769069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.769071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.769163 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.769466 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.769470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.769472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.769701 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:33.769823 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:33.770255 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 18:38:33.770412 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 18:38:33.771450 4721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:33.757656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34961 (local address 127.4.61.193:48225)
0808 18:38:33.758278 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:33.758356 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:33.759974 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:33.760596 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:33.760607 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:33.761115 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:33.761817 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:33.761839 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.762764 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.762768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:33.763816 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:33.763830 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.764567 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.764573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:33.764877 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:33.765427 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:33.765444 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:33.766849 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:33.768701 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:33.768706 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:33.768717 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:33.768969 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:33.769246 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:33.769248 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:33.769249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:33.769367 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:33.769801 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:33.769806 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:33.770028 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 18:38:33.770178 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 18:38:33.770493 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":239,"threads_started":1}
I20260808 18:38:33.772761 4717 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:38:33.773041 4717 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:33.773521 4717 heartbeater.cc:511] Master 127.4.61.254:34961 requested a full tablet report, sending...
I20260808 18:38:33.775384 4417 ts_manager.cc:194] Registered new tserver with Master: 1d814d96c506442aa8da7709d7c65dcd (127.4.61.193:43723)
I20260808 18:38:33.776826 4417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:48225
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:33.789306 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:33.904517 4726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:33.904783 4726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:33.904848 4726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:33.908914 4726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:33.908986 4726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:33.909068 4726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:33.914300 4726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:33.915434 4726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:33.916471 4726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:33.926100 4736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:33.926105 4742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:33.926141 4726 server_base.cc:1034] running on GCE node
W20260808 18:38:33.926113 4733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:33.926682 4726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:33.927373 4726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:33.928547 4726 hybrid_clock.cc:648] HybridClock initialized: now 1786214313928517 us; error 40 us; skew 500 ppm
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:33.931272 4726 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:33.932113 4726 webserver.cc:460] Webserver started at http://127.4.61.194:44175/ using document root <none> and password file <none>
I20260808 18:38:33.932647 4726 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:33.932713 4726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:33.932929 4726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:33.934953 4726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "590ed34198ab48d4be2393a2f277cf05"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "d37d0646d3bd4d42a2a7d7334b71c423"
server_key_iv: "85922f9ae31a77aae5366b0a5978bf00"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.935487 4726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "590ed34198ab48d4be2393a2f277cf05"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "d37d0646d3bd4d42a2a7d7334b71c423"
server_key_iv: "85922f9ae31a77aae5366b0a5978bf00"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.939254 4726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:33.941870 4751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.943142 4726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:38:33.943259 4726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "590ed34198ab48d4be2393a2f277cf05"
format_stamp: "Formatted at 2026-08-08 18:38:33 on dist-test-slave-fgb3"
server_key: "d37d0646d3bd4d42a2a7d7334b71c423"
server_key_iv: "85922f9ae31a77aae5366b0a5978bf00"
server_key_version: "encryptionkey@0"
I20260808 18:38:33.943368 4726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:33.959929 4726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:33.963027 4726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:33.963220 4726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:33.963826 4726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:33.964663 4726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:33.964711 4726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.964763 4726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:33.964793 4726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:33.979138 4726 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:46043
I20260808 18:38:33.979167 4922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:46043 every 8 connection(s)
I20260808 18:38:33.980057 4726 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:33.986613 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4726
I20260808 18:38:33.986732 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:33.986999 4343 external_mini_cluster.cc:1428] Setting key f9572c6cf9976768888dfd19615bee09
Aug 08 18:38:33 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214313, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:33.994093 4482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:33.981999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:56045 (local address 127.4.61.254:34961)
0808 18:38:33.982148 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:33.982153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:33.983070 (+ 917us) server_negotiation.cc:407] Connection header received
0808 18:38:33.984371 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:33.984374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:33.984424 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:33.984498 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:33.985651 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.986185 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.987402 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.987655 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.987763 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:33.990520 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:33.990523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:33.990526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:33.990553 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:33.991915 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.992457 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.992461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.992463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.992562 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:33.992867 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:33.992870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:33.992872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:33.993113 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:33.993220 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:33.993800 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 18:38:33.993932 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 18:38:33.994967 4926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:33.982461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34961 (local address 127.4.61.194:56045)
0808 18:38:33.982914 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:33.982958 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:33.984171 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:33.984650 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:33.984657 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:33.985027 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:33.985527 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:33.985542 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.986279 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.986281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:33.987262 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:33.987271 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:33.987814 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:33.987818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:33.988011 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:33.988666 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:33.988684 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:33.990307 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:33.992051 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:33.992056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:33.992070 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:33.992334 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:33.992643 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:33.992645 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:33.992646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:33.992785 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:33.993250 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:33.993256 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:33.993527 (+ 271us) client_negotiation.cc:769] Sending connection context
0808 18:38:33.993700 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 18:38:33.994003 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":122,"threads_started":1}
I20260808 18:38:33.996173 4923 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34961
I20260808 18:38:33.996477 4923 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:33.997148 4923 heartbeater.cc:511] Master 127.4.61.254:34961 requested a full tablet report, sending...
I20260808 18:38:33.998461 4417 ts_manager.cc:194] Registered new tserver with Master: 590ed34198ab48d4be2393a2f277cf05 (127.4.61.194:46043)
I20260808 18:38:33.999106 4417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:56045
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:34.019272 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:34.136171 4929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:34.136433 4929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:34.136476 4929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:34.140537 4929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:34.140599 4929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:34.140674 4929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:34.145951 4929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34961
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:34.147039 4929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:34.148124 4929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:34.157548 4936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:34.157627 4938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:34.157577 4941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:34.157757 4929 server_base.cc:1034] running on GCE node
I20260808 18:38:34.158241 4929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:34.158874 4929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:34.160022 4929 hybrid_clock.cc:648] HybridClock initialized: now 1786214314159994 us; error 43 us; skew 500 ppm
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:34.162705 4929 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:34.163594 4929 webserver.cc:460] Webserver started at http://127.4.61.195:40965/ using document root <none> and password file <none>
I20260808 18:38:34.164106 4929 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:34.164161 4929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:34.164352 4929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:34.166365 4929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "9cda55fcfe1d4377bc9e1cd2afaf2d0d"
format_stamp: "Formatted at 2026-08-08 18:38:34 on dist-test-slave-fgb3"
server_key: "65c3825ce87d599a6b73ec2ef01dabf5"
server_key_iv: "c812fb84fa5f836f72873a9fe28156fa"
server_key_version: "encryptionkey@0"
I20260808 18:38:34.166970 4929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "9cda55fcfe1d4377bc9e1cd2afaf2d0d"
format_stamp: "Formatted at 2026-08-08 18:38:34 on dist-test-slave-fgb3"
server_key: "65c3825ce87d599a6b73ec2ef01dabf5"
server_key_iv: "c812fb84fa5f836f72873a9fe28156fa"
server_key_version: "encryptionkey@0"
I20260808 18:38:34.171180 4929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 18:38:34.173640 4952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:34.174955 4929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:38:34.175066 4929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "9cda55fcfe1d4377bc9e1cd2afaf2d0d"
format_stamp: "Formatted at 2026-08-08 18:38:34 on dist-test-slave-fgb3"
server_key: "65c3825ce87d599a6b73ec2ef01dabf5"
server_key_iv: "c812fb84fa5f836f72873a9fe28156fa"
server_key_version: "encryptionkey@0"
I20260808 18:38:34.175158 4929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:34.196024 4929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:34.199146 4929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:34.199322 4929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:34.199924 4929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:34.200835 4929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:34.200883 4929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:34.200924 4929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:34.200944 4929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:34.214936 4929 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45911
I20260808 18:38:34.214947 5121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45911 every 8 connection(s)
I20260808 18:38:34.215950 4929 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:34.218379 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4929
I20260808 18:38:34.218489 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:34.218741 4343 external_mini_cluster.cc:1428] Setting key 4fe9a876c25773b04159c604da3781df
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:34.229772 4482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:34.218057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:41199 (local address 127.4.61.254:34961)
0808 18:38:34.218239 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:34.218244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:34.219252 (+ 1008us) server_negotiation.cc:407] Connection header received
0808 18:38:34.220890 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:34.220892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:34.220937 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:34.221009 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:34.222275 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.222877 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.224010 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.224249 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.224334 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:34.226838 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:34.226841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:34.226843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:34.226868 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:34.228093 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.228548 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.228550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.228551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.228623 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.228877 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.228879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.228880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.229043 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:34.229111 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:34.229553 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 18:38:34.229654 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 18:38:34.230629 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:34.218546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34961 (local address 127.4.61.195:41199)
0808 18:38:34.219067 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:34.219131 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:34.220679 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:34.221198 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:34.221208 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:34.221643 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:34.222134 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:34.222148 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.222974 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.222976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:34.223885 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:34.223894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.224415 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.224419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:34.224604 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:34.225139 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:34.225156 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:34.226648 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:34.228189 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:34.228194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:34.228206 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:34.228463 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:34.228685 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:34.228687 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:34.228688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:34.228814 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:34.229110 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:34.229114 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:34.229342 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 18:38:34.229511 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 18:38:34.229766 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":115,"threads_started":1}
I20260808 18:38:34.231673 5122 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34961
I20260808 18:38:34.231895 5122 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:34.232465 5122 heartbeater.cc:511] Master 127.4.61.254:34961 requested a full tablet report, sending...
I20260808 18:38:34.233489 4417 ts_manager.cc:194] Registered new tserver with Master: 9cda55fcfe1d4377bc9e1cd2afaf2d0d (127.4.61.195:45911)
I20260808 18:38:34.234019 4417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:41199
I20260808 18:38:34.245182 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:34.273731 5132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:34.264386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60340 (local address 127.4.61.193:43723)
0808 18:38:34.264665 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:34.264682 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:34.264708 (+ 26us) server_negotiation.cc:407] Connection header received
0808 18:38:34.264772 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:34.264777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:34.264973 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:34.265278 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:34.265899 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.266814 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.267713 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.268107 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.268206 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:34.270505 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:34.270515 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:34.270531 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:34.270557 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:34.271985 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.272361 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.272366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.272367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.272443 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.272700 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.272705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.272706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.272985 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:34.273202 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:34.273406 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 18:38:34.273571 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":100,"threads_started":1}
W20260808 18:38:34.274825 4585 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60340
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[4352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:34.304956 5132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:34.296868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60348 (local address 127.4.61.193:43723)
0808 18:38:34.297027 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:34.297032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:34.297272 (+ 240us) server_negotiation.cc:407] Connection header received
0808 18:38:34.297437 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:34.297441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:34.297490 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:34.297561 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:34.298287 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.298919 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.299793 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:34.300032 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:34.300126 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:34.302428 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:34.302431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:34.302433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:34.302462 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:34.303614 (+ 1152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.303995 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.303999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.304000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.304080 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:34.304274 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:34.304276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:34.304277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:34.304435 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:34.304547 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:34.304696 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 18:38:34.304798 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:38:34.305998 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4517
I20260808 18:38:34.318061 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4726
I20260808 18:38:34.329329 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4929
I20260808 18:38:34.338263 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4374
2026-08-08T18:38:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2344 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[5144](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[5144](info): set up 2 sockets
Aug 08 18:38:34 dist-test-slave-fgb3 krb5kdc[5144](info): commencing operation
krb5kdc: starting...
W20260808 18:38:35.484009 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:35 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:35.608649 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42015
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:42015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:35.722381 5159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:35.722640 5159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:35.722680 5159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:35.726761 5159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:35.726822 5159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:35.726840 5159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:35.726854 5159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:35.726868 5159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:35.732071 5159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:42015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:35.733093 5159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:35.734114 5159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:35.742475 5169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:35.742483 5168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:35.742676 5171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:35.742697 5159 server_base.cc:1034] running on GCE node
I20260808 18:38:35.743427 5159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:35.744501 5159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:35.745661 5159 hybrid_clock.cc:648] HybridClock initialized: now 1786214315745637 us; error 37 us; skew 500 ppm
Aug 08 18:38:35 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214315, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:35.748306 5159 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:35.749183 5159 webserver.cc:460] Webserver started at http://127.4.61.254:34787/ using document root <none> and password file <none>
I20260808 18:38:35.749697 5159 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:35.749752 5159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:35.749929 5159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:35.751928 5159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "4a38499e28cb46658ca38ac478d3556d"
format_stamp: "Formatted at 2026-08-08 18:38:35 on dist-test-slave-fgb3"
server_key: "b2ca22874806d9e97c123d132654e786"
server_key_iv: "b5521b7ac15083564e57a700ecd34157"
server_key_version: "encryptionkey@0"
I20260808 18:38:35.752446 5159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "4a38499e28cb46658ca38ac478d3556d"
format_stamp: "Formatted at 2026-08-08 18:38:35 on dist-test-slave-fgb3"
server_key: "b2ca22874806d9e97c123d132654e786"
server_key_iv: "b5521b7ac15083564e57a700ecd34157"
server_key_version: "encryptionkey@0"
I20260808 18:38:35.756093 5159 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 18:38:35.758517 5182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:35.759732 5159 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:38:35.759840 5159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "4a38499e28cb46658ca38ac478d3556d"
format_stamp: "Formatted at 2026-08-08 18:38:35 on dist-test-slave-fgb3"
server_key: "b2ca22874806d9e97c123d132654e786"
server_key_iv: "b5521b7ac15083564e57a700ecd34157"
server_key_version: "encryptionkey@0"
I20260808 18:38:35.759930 5159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:35.776783 5159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:35.779831 5159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:35.780004 5159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:35.787400 5159 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:42015
I20260808 18:38:35.787416 5264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:42015 every 8 connection(s)
I20260808 18:38:35.788393 5159 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:35.791262 5266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:35.795203 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5159
I20260808 18:38:35.795392 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:35.795720 4343 external_mini_cluster.cc:1428] Setting key 98e008ad622cf3c3563817390c7ecdac
I20260808 18:38:35.797519 5266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d: Bootstrap starting.
I20260808 18:38:35.799858 5266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:35.800581 5266 log.cc:824] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:35.802454 5266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d: No bootstrap required, opened a new log
Aug 08 18:38:35 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:35.806552 5266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } }
I20260808 18:38:35.806800 5266 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:35.806841 5266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a38499e28cb46658ca38ac478d3556d, State: Initialized, Role: FOLLOWER
I20260808 18:38:35.807277 5266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } }
I20260808 18:38:35.807408 5266 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:35.807474 5266 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:35.807571 5266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:35.808537 5266 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } }
I20260808 18:38:35.808876 5266 leader_election.cc:302] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a38499e28cb46658ca38ac478d3556d; no voters:
I20260808 18:38:35.809221 5266 leader_election.cc:288] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:35.809303 5279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:35.809540 5279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [term 1 LEADER]: Becoming Leader. State: Replica: 4a38499e28cb46658ca38ac478d3556d, State: Running, Role: LEADER
I20260808 18:38:35.809923 5279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } }
I20260808 18:38:35.810357 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:35.797251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42464 (local address 127.4.61.254:42015)
0808 18:38:35.797727 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:35.797744 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:35.797781 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:38:35.798505 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:35.798526 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:35.798862 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:35.799181 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:35.799981 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:35.801027 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:35.801862 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:35.802382 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:35.802529 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:35.805324 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:35.805329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:35.805344 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:35.805372 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:35.807178 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:35.807623 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:35.807629 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:35.807635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:35.807768 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:35.808068 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:35.808072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:35.808074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:35.808496 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:35.808679 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:35.808976 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 18:38:35.809328 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":138,"threads_started":1}
I20260808 18:38:35.810721 5266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:35.811622 5282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a38499e28cb46658ca38ac478d3556d. Latest consensus state: current_term: 1 leader_uuid: "4a38499e28cb46658ca38ac478d3556d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } } }
I20260808 18:38:35.811769 5282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:35.812027 5280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a38499e28cb46658ca38ac478d3556d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a38499e28cb46658ca38ac478d3556d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42015 } } }
I20260808 18:38:35.812203 5280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:35.812891 5293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:35.815757 5293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:35.821168 5293 catalog_manager.cc:1347] Generated new cluster ID: 907b5376ad9c4c62a3b853b6c82da966
I20260808 18:38:35.821228 5293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:35.846899 5293 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:35.847945 5293 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:35.858078 5293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a38499e28cb46658ca38ac478d3556d: Generated new TSK 0
I20260808 18:38:35.858865 5293 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:35.886561 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:35.998533 5312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:35.998795 5312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:35.998839 5312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:36.002835 5312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:36.002890 5312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:36.002964 5312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:36.008183 5312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:36.009231 5312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:36.010236 5312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:36.019979 5320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:36.019986 5325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:36.020021 5322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:36.020298 5312 server_base.cc:1034] running on GCE node
I20260808 18:38:36.020750 5312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:36.021377 5312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:36.022548 5312 hybrid_clock.cc:648] HybridClock initialized: now 1786214316022517 us; error 41 us; skew 500 ppm
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:36.025171 5312 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:36.026028 5312 webserver.cc:460] Webserver started at http://127.4.61.193:41123/ using document root <none> and password file <none>
I20260808 18:38:36.026620 5312 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:36.026685 5312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:36.026899 5312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:36.028954 5312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "15c7f12ee2fc49d287129f1df52bced5"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "fa5e41d9c38028b1c4cdf66bc5787997"
server_key_iv: "56c09d455f3dd36de6c75b5c245df597"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.029496 5312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "15c7f12ee2fc49d287129f1df52bced5"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "fa5e41d9c38028b1c4cdf66bc5787997"
server_key_iv: "56c09d455f3dd36de6c75b5c245df597"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.033134 5312 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:36.035499 5334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.036652 5312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:36.036756 5312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "15c7f12ee2fc49d287129f1df52bced5"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "fa5e41d9c38028b1c4cdf66bc5787997"
server_key_iv: "56c09d455f3dd36de6c75b5c245df597"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.036861 5312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:36.053347 5312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:36.056241 5312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:36.056434 5312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:36.057049 5312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:36.057915 5312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:36.057981 5312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.058038 5312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:36.058066 5312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.067034 5312 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:43017
I20260808 18:38:36.067071 5526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:43017 every 8 connection(s)
I20260808 18:38:36.068042 5312 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:36.072595 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5312
I20260808 18:38:36.072721 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:36.073014 4343 external_mini_cluster.cc:1428] Setting key d0746bf3e9aa029beee7dc41ef5253bd
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:36.082442 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.069940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38021 (local address 127.4.61.254:42015)
0808 18:38:36.070089 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.070094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.071011 (+ 917us) server_negotiation.cc:407] Connection header received
0808 18:38:36.072325 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.072328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.072377 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.072447 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.073961 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.074548 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.075695 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.075934 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.076030 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.078738 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.078741 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.078743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.078768 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.080361 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.080850 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.080854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.080856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.080956 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.081249 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.081252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.081253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.081502 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.081608 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.082085 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.082221 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:38:36.083182 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.070396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42015 (local address 127.4.61.193:38021)
0808 18:38:36.070847 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.070904 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.072133 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.072663 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.072674 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.073179 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:36.073812 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.073830 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.074669 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.074673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.075575 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.075585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.076198 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.076201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.076356 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.076948 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:36.076965 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:36.078572 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:36.080484 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.080489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.080502 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.080756 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.081040 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.081042 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.081043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.081169 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.081592 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:36.081597 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:36.081846 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.082006 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.082266 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:36.084386 5528 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42015
I20260808 18:38:36.084642 5528 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:36.085197 5528 heartbeater.cc:511] Master 127.4.61.254:42015 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:38:36.086941 5203 ts_manager.cc:194] Registered new tserver with Master: 15c7f12ee2fc49d287129f1df52bced5 (127.4.61.193:43017)
I20260808 18:38:36.088073 5203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:38021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:36.101560 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:36.216833 5534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:36.217104 5534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:36.217151 5534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:36.221359 5534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:36.221429 5534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:36.221493 5534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:36.226946 5534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:36.228081 5534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:36.229110 5534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:36.238780 5553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:36.238862 5549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:36.238852 5534 server_base.cc:1034] running on GCE node
W20260808 18:38:36.238786 5555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:36.239555 5534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:36.240258 5534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:36.241462 5534 hybrid_clock.cc:648] HybridClock initialized: now 1786214316241438 us; error 33 us; skew 500 ppm
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:36.244338 5534 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:36.245353 5534 webserver.cc:460] Webserver started at http://127.4.61.194:39829/ using document root <none> and password file <none>
I20260808 18:38:36.245949 5534 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:36.246017 5534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:36.246220 5534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:36.248427 5534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "0de9980502b349c6a63186346291634a"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "0764c26346c6219fd09fd663c06f44fd"
server_key_iv: "fd61b82e746c6ac956c63bb4bc4f267b"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.248977 5534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "0de9980502b349c6a63186346291634a"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "0764c26346c6219fd09fd663c06f44fd"
server_key_iv: "fd61b82e746c6ac956c63bb4bc4f267b"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.252843 5534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:38:36.255177 5568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.256410 5534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:36.256533 5534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "0de9980502b349c6a63186346291634a"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "0764c26346c6219fd09fd663c06f44fd"
server_key_iv: "fd61b82e746c6ac956c63bb4bc4f267b"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.256629 5534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:36.272147 5534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:36.275525 5534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:36.275715 5534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:36.276356 5534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:36.277215 5534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:36.277264 5534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.277305 5534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:36.277318 5534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.286448 5534 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:36251
I20260808 18:38:36.286473 5770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:36251 every 8 connection(s)
I20260808 18:38:36.287343 5534 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:36.289067 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5534
I20260808 18:38:36.289187 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:36.289471 4343 external_mini_cluster.cc:1428] Setting key 2d4ee8496cec0bb5fab5fc49ea456ed7
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:36.302174 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.289158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:40773 (local address 127.4.61.254:42015)
0808 18:38:36.289885 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.289890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.290229 (+ 339us) server_negotiation.cc:407] Connection header received
0808 18:38:36.291893 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.291896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.291941 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.292011 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.293539 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.294356 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.295505 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.295861 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.295984 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.298666 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.298670 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.298673 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.298702 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.300248 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.300728 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.300730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.300732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.300807 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.301118 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.301121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.301122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.301295 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.301363 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.301932 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.302040 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:38:36.303232 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.289535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42015 (local address 127.4.61.194:40773)
0808 18:38:36.290084 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.290140 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.291658 (+ 1518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.292217 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.292226 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.292699 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:36.293377 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.293393 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.294470 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.294473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.295378 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.295388 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.296027 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.296031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.296176 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.296795 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:36.296812 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:36.298492 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:36.300375 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.300381 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.300394 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.300642 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.300876 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.300878 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.300879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.301038 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.301478 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:36.301484 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:36.301724 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.301891 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.302206 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":166,"threads_started":1}
I20260808 18:38:36.304389 5771 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42015
I20260808 18:38:36.304627 5771 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:36.305112 5771 heartbeater.cc:511] Master 127.4.61.254:42015 requested a full tablet report, sending...
I20260808 18:38:36.306188 5203 ts_manager.cc:194] Registered new tserver with Master: 0de9980502b349c6a63186346291634a (127.4.61.194:36251)
I20260808 18:38:36.306993 5203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:40773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:36.317553 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:36.430282 5779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:36.430590 5779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:36.430634 5779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:36.434574 5779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:36.434628 5779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:36.434685 5779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:36.439944 5779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42015
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:36.441030 5779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:36.442114 5779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:36.451685 5787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:36.451704 5789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:36.451697 5793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:36.451861 5779 server_base.cc:1034] running on GCE node
I20260808 18:38:36.452348 5779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:36.452971 5779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:36.454134 5779 hybrid_clock.cc:648] HybridClock initialized: now 1786214316454106 us; error 39 us; skew 500 ppm
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:36.462951 5779 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:36.464169 5779 webserver.cc:460] Webserver started at http://127.4.61.195:41365/ using document root <none> and password file <none>
I20260808 18:38:36.464783 5779 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:36.464856 5779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:36.465068 5779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:36.467308 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "52793127551749d0983b932003f6e42e"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "769114f35767ca24b807170ab2c0f59b"
server_key_iv: "e12fb10459a10546570101381fdbfd27"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.467900 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "52793127551749d0983b932003f6e42e"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "769114f35767ca24b807170ab2c0f59b"
server_key_iv: "e12fb10459a10546570101381fdbfd27"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.471724 5779 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:36.474166 5802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.475406 5779 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:36.475519 5779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "52793127551749d0983b932003f6e42e"
format_stamp: "Formatted at 2026-08-08 18:38:36 on dist-test-slave-fgb3"
server_key: "769114f35767ca24b807170ab2c0f59b"
server_key_iv: "e12fb10459a10546570101381fdbfd27"
server_key_version: "encryptionkey@0"
I20260808 18:38:36.475615 5779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:36.490738 5779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:36.493881 5779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:36.494076 5779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:36.494764 5779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:36.495651 5779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:36.495702 5779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.495757 5779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:36.495787 5779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:36.504971 5779 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:37925
I20260808 18:38:36.504993 5963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:37925 every 8 connection(s)
I20260808 18:38:36.505885 5779 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:36.514482 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5779
I20260808 18:38:36.514616 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:36.514894 4343 external_mini_cluster.cc:1428] Setting key 5cbb3ed97d4de00e922d3d2098eadfb1
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:36.519409 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.507866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:38145 (local address 127.4.61.254:42015)
0808 18:38:36.508010 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.508014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.508823 (+ 809us) server_negotiation.cc:407] Connection header received
0808 18:38:36.510127 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.510130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.510206 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.510332 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.511610 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.512137 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.513343 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.513571 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.513661 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.516300 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.516304 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.516307 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.516337 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.517629 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.518087 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.518090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.518091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.518160 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.518485 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.518488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.518489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.518667 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.518741 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.519163 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.519283 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:38:36.520169 5969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.508232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42015 (local address 127.4.61.195:38145)
0808 18:38:36.508677 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.508718 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.509924 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.510524 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.510531 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.510898 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:36.511483 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.511500 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.512226 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.512228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.513159 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.513169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.513693 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.513696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.513832 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.514568 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:36.514585 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:36.516117 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:36.517728 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.517733 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.517745 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.518014 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.518218 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:36.518220 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:36.518222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:36.518412 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:36.518739 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:36.518744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:36.518978 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.519122 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.519362 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":110,"threads_started":1}
I20260808 18:38:36.521200 5965 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42015
I20260808 18:38:36.521415 5965 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:36.521879 5965 heartbeater.cc:511] Master 127.4.61.254:42015 requested a full tablet report, sending...
I20260808 18:38:36.522905 5203 ts_manager.cc:194] Registered new tserver with Master: 52793127551749d0983b932003f6e42e (127.4.61.195:37925)
I20260808 18:38:36.523433 5203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:38145
I20260808 18:38:36.528676 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:38:36.538904 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.532049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42472 (local address 127.4.61.254:42015)
0808 18:38:36.532176 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.532182 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.532340 (+ 158us) server_negotiation.cc:407] Connection header received
0808 18:38:36.532461 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.532465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.532511 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.532576 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.533280 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.533788 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.534633 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.534859 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.534969 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.536171 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.536174 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.536177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.536204 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.537288 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.537671 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.537675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.537677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.537761 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.538016 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.538020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.538021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.538253 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.538419 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.538634 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.538748 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:38:36.543855 5203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42472:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:36.547037 5203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:36.561910 5989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.556973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45402 (local address 127.4.61.194:36251)
0808 18:38:36.557564 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.557575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.557595 (+ 20us) server_negotiation.cc:407] Connection header received
0808 18:38:36.557667 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.557672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.557850 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.558007 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:36.558170 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.559223 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.560417 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561136 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561235 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561393 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.561634 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.561737 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":144,"threads_started":1}
I20260808 18:38:36.561896 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.555833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:43017 (local address 127.0.0.1:59118)
0808 18:38:36.556542 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.556594 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.556732 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.557509 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.557512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.557531 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:36.557638 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.557644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.559136 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.559140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.560266 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.560274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561502 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.561577 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561601 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.561671 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.561744 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":26,"thread_start_us":109,"threads_started":1}
I20260808 18:38:36.561914 5986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.556576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:36251 (local address 127.0.0.1:45402)
0808 18:38:36.557125 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.557138 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.557219 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.557987 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.557990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.558010 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:36.558085 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.558091 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.559345 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.559348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.560287 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.560297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561252 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.561423 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561471 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.561582 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.561706 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":84,"threads_started":1}
I20260808 18:38:36.561915 5983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.556117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:37925 (local address 127.0.0.1:40074)
0808 18:38:36.556709 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.556722 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.556792 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.557455 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.557461 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.557484 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:36.557621 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.557629 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.558833 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.558836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.560232 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.560244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561469 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.561550 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561571 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.561649 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.561706 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":20,"thread_start_us":96,"threads_started":1}
I20260808 18:38:36.562603 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.556034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.4.61.193:43017)
0808 18:38:36.556570 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.556589 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.556885 (+ 296us) server_negotiation.cc:407] Connection header received
0808 18:38:36.556971 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.556976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.557179 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.557323 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:36.557760 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.558993 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.560393 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561195 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561298 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561436 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.562359 (+ 923us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.562474 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":111,"threads_started":1}
I20260808 18:38:36.562714 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.556304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40074 (local address 127.4.61.195:37925)
0808 18:38:36.556770 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.556783 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.556809 (+ 26us) server_negotiation.cc:407] Connection header received
0808 18:38:36.556894 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.556899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.557114 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.557266 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:36.557758 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.558709 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.560373 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.561195 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.561298 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.561436 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.561982 (+ 546us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.562573 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":166,"threads_started":1}
I20260808 18:38:36.565315 5404 tablet_service.cc:1467] Processing CreateTablet for tablet 0199489890f549cead2d85df5fdd0e20 (DEFAULT_TABLE table=test-table [id=a64950109db540d19b1bcd035fd61849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:36.565311 5650 tablet_service.cc:1467] Processing CreateTablet for tablet 0199489890f549cead2d85df5fdd0e20 (DEFAULT_TABLE table=test-table [id=a64950109db540d19b1bcd035fd61849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:36.566265 5650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0199489890f549cead2d85df5fdd0e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:36.566295 5404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0199489890f549cead2d85df5fdd0e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:36.566994 5868 tablet_service.cc:1467] Processing CreateTablet for tablet 0199489890f549cead2d85df5fdd0e20 (DEFAULT_TABLE table=test-table [id=a64950109db540d19b1bcd035fd61849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:36.567983 5868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0199489890f549cead2d85df5fdd0e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:36.573168 5991 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: Bootstrap starting.
I20260808 18:38:36.574234 5992 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: Bootstrap starting.
I20260808 18:38:36.574800 5993 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: Bootstrap starting.
I20260808 18:38:36.575879 5991 tablet_bootstrap.cc:654] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:36.576565 5993 tablet_bootstrap.cc:654] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:36.576956 5992 tablet_bootstrap.cc:654] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:36.577399 5991 log.cc:824] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:36.577708 5993 log.cc:824] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:36.577764 5992 log.cc:824] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:36.579736 5993 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: No bootstrap required, opened a new log
I20260808 18:38:36.579741 5991 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: No bootstrap required, opened a new log
I20260808 18:38:36.579741 5992 tablet_bootstrap.cc:492] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: No bootstrap required, opened a new log
I20260808 18:38:36.579921 5991 ts_tablet_manager.cc:1397] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 18:38:36.579921 5992 ts_tablet_manager.cc:1397] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 18:38:36.579929 5993 ts_tablet_manager.cc:1397] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:38:36.582897 5993 raft_consensus.cc:348] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.583127 5993 raft_consensus.cc:374] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:36.583178 5993 raft_consensus.cc:729] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52793127551749d0983b932003f6e42e, State: Initialized, Role: FOLLOWER
I20260808 18:38:36.583573 5993 consensus_queue.cc:260] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.583683 5992 raft_consensus.cc:348] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.583683 5991 raft_consensus.cc:348] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.583948 5992 raft_consensus.cc:374] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:36.583948 5991 raft_consensus.cc:374] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:36.584007 5992 raft_consensus.cc:729] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de9980502b349c6a63186346291634a, State: Initialized, Role: FOLLOWER
I20260808 18:38:36.584017 5991 raft_consensus.cc:729] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c7f12ee2fc49d287129f1df52bced5, State: Initialized, Role: FOLLOWER
I20260808 18:38:36.584429 5992 consensus_queue.cc:260] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.584440 5991 consensus_queue.cc:260] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.585186 5528 heartbeater.cc:503] Master 127.4.61.254:42015 was elected leader, sending a full tablet report...
I20260808 18:38:36.585351 5992 ts_tablet_manager.cc:1428] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 18:38:36.585361 5991 ts_tablet_manager.cc:1428] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:38:36.585675 5771 heartbeater.cc:503] Master 127.4.61.254:42015 was elected leader, sending a full tablet report...
I20260808 18:38:36.586005 5965 heartbeater.cc:503] Master 127.4.61.254:42015 was elected leader, sending a full tablet report...
I20260808 18:38:36.586104 5993 ts_tablet_manager.cc:1428] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 18:38:36.587771 6003 raft_consensus.cc:482] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:36.587937 6003 raft_consensus.cc:504] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.589169 6003 leader_election.cc:288] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c7f12ee2fc49d287129f1df52bced5 (127.4.61.193:43017), 0de9980502b349c6a63186346291634a (127.4.61.194:36251)
I20260808 18:38:36.593392 5969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.589391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:43017 (local address 127.4.61.195:38413)
0808 18:38:36.590164 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.590180 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.590260 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.590592 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.590596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.590615 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:36.590716 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.590720 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.591597 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.591601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.592381 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.592391 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.592989 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.592992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.593097 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.593119 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.593185 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.593256 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696}
I20260808 18:38:36.593385 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.590150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:38413 (local address 127.4.61.193:43017)
0808 18:38:36.590245 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.590250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.590262 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:38:36.590359 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.590363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.590416 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.590476 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:36.590825 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.591494 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.592500 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.592888 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.592989 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.593042 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.593209 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.593277 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 18:38:36.594046 5441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0199489890f549cead2d85df5fdd0e20" candidate_uuid: "52793127551749d0983b932003f6e42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c7f12ee2fc49d287129f1df52bced5" is_pre_election: true
I20260808 18:38:36.594261 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.589670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:36251 (local address 127.4.61.195:37367)
0808 18:38:36.591097 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:36.591109 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:36.591202 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:36.591407 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:36.591410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:36.591425 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:36.591570 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.591577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.592247 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.592250 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.593022 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:36.593030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.593831 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.593835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:36.593926 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.593949 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:38:36.594059 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 18:38:36.594128 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"thread_start_us":241,"threads_started":1}
I20260808 18:38:36.594269 5989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.590487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:37367 (local address 127.4.61.194:36251)
0808 18:38:36.590592 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.590597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.591189 (+ 592us) server_negotiation.cc:407] Connection header received
0808 18:38:36.591277 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.591280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.591320 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.591388 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:36.591672 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.592148 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.593133 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.593605 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.593705 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.593750 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.594082 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.594157 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 18:38:36.594753 5441 raft_consensus.cc:2454] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52793127551749d0983b932003f6e42e in term 0.
I20260808 18:38:36.594822 5686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0199489890f549cead2d85df5fdd0e20" candidate_uuid: "52793127551749d0983b932003f6e42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de9980502b349c6a63186346291634a" is_pre_election: true
I20260808 18:38:36.595094 5686 raft_consensus.cc:2454] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52793127551749d0983b932003f6e42e in term 0.
I20260808 18:38:36.595230 5803 leader_election.cc:302] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c7f12ee2fc49d287129f1df52bced5, 52793127551749d0983b932003f6e42e; no voters:
I20260808 18:38:36.595517 6003 raft_consensus.cc:2781] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:36.595597 6003 raft_consensus.cc:482] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:36.595626 6003 raft_consensus.cc:3037] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:36.596690 6003 raft_consensus.cc:504] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.597018 6003 leader_election.cc:288] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [CANDIDATE]: Term 1 election: Requested vote from peers 15c7f12ee2fc49d287129f1df52bced5 (127.4.61.193:43017), 0de9980502b349c6a63186346291634a (127.4.61.194:36251)
I20260808 18:38:36.597378 5441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0199489890f549cead2d85df5fdd0e20" candidate_uuid: "52793127551749d0983b932003f6e42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c7f12ee2fc49d287129f1df52bced5"
I20260808 18:38:36.597404 5686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0199489890f549cead2d85df5fdd0e20" candidate_uuid: "52793127551749d0983b932003f6e42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de9980502b349c6a63186346291634a"
I20260808 18:38:36.597506 5686 raft_consensus.cc:3037] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:36.597506 5441 raft_consensus.cc:3037] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:36.598814 5686 raft_consensus.cc:2454] T 0199489890f549cead2d85df5fdd0e20 P 0de9980502b349c6a63186346291634a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52793127551749d0983b932003f6e42e in term 1.
I20260808 18:38:36.598814 5441 raft_consensus.cc:2454] T 0199489890f549cead2d85df5fdd0e20 P 15c7f12ee2fc49d287129f1df52bced5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52793127551749d0983b932003f6e42e in term 1.
I20260808 18:38:36.599115 5803 leader_election.cc:302] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c7f12ee2fc49d287129f1df52bced5, 52793127551749d0983b932003f6e42e; no voters:
I20260808 18:38:36.599295 6003 raft_consensus.cc:2781] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:36.599509 6003 raft_consensus.cc:686] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [term 1 LEADER]: Becoming Leader. State: Replica: 52793127551749d0983b932003f6e42e, State: Running, Role: LEADER
I20260808 18:38:36.599831 6003 consensus_queue.cc:237] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } }
I20260808 18:38:36.603022 5203 catalog_manager.cc:5495] T 0199489890f549cead2d85df5fdd0e20 P 52793127551749d0983b932003f6e42e reported cstate change: term changed from 0 to 1, leader changed from <none> to 52793127551749d0983b932003f6e42e (127.4.61.195). New cstate: current_term: 1 leader_uuid: "52793127551749d0983b932003f6e42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c7f12ee2fc49d287129f1df52bced5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 43017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0de9980502b349c6a63186346291634a" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52793127551749d0983b932003f6e42e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37925 } health_report { overall_health: HEALTHY } } }
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:36.627950 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.619218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.4.61.193:43017)
0808 18:38:36.619360 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.619365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.619522 (+ 157us) server_negotiation.cc:407] Connection header received
0808 18:38:36.619664 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.619668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.619714 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.619781 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.620465 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.620970 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.621803 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.622026 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.622112 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.624431 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.624444 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.624461 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.624486 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.626027 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.626598 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.626604 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.626606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.626713 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.626999 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.627002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.627004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.627280 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.627502 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.627670 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.627792 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:36.655328 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.647614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59136 (local address 127.4.61.193:43017)
0808 18:38:36.647734 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.647738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.648092 (+ 354us) server_negotiation.cc:407] Connection header received
0808 18:38:36.648218 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.648221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.648267 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.648335 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.648970 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.649467 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.650207 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.650450 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.650522 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.652718 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.652721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.652724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.652748 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.653887 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.654238 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.654241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.654242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.654383 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.654588 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.654590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.654591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.654744 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.654837 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.655043 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.655139 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[5144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:36.681887 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:36.673733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.4.61.193:43017)
0808 18:38:36.673873 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:36.673877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:36.674021 (+ 144us) server_negotiation.cc:407] Connection header received
0808 18:38:36.674156 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:36.674159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:36.674204 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:36.674270 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:36.674965 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.675453 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.676265 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:36.676477 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:36.676565 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:36.678980 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:36.678983 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:36.678985 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:36.679012 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:36.680421 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.680790 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.680792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.680794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.680862 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:36.681084 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:36.681088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:36.681089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:36.681271 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:36.681389 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:36.681616 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 18:38:36.681712 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 18:38:36.683525 5370 tablet_service.cc:2908] Rejecting scan request for tablet 0199489890f549cead2d85df5fdd0e20: Uninitialized: clean time has not yet been initialized
I20260808 18:38:36.685611 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5312
I20260808 18:38:36.701968 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5534
I20260808 18:38:36.714099 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5779
I20260808 18:38:36.729002 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5159
2026-08-08T18:38:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2390 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[6027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[6027](info): set up 2 sockets
Aug 08 18:38:36 dist-test-slave-fgb3 krb5kdc[6027](info): commencing operation
krb5kdc: starting...
W20260808 18:38:37.877028 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:37 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:37.998582 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33963
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:33963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:38.107641 6045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:38.107906 6045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:38.107975 6045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:38.111896 6045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:38.111955 6045 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 18:38:38.111979 6045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:38.112001 6045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:38.112023 6045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:38.112051 6045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:38.117235 6045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:33963
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:38.118304 6045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:38.119342 6045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:38.127527 6053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.127538 6050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:38.127719 6045 server_base.cc:1034] running on GCE node
W20260808 18:38:38.127538 6051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:38.128399 6045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:38.129407 6045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:38.130558 6045 hybrid_clock.cc:648] HybridClock initialized: now 1786214318130531 us; error 37 us; skew 500 ppm
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:38.133174 6045 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:38.134085 6045 webserver.cc:460] Webserver started at http://127.4.61.254:35175/ using document root <none> and password file <none>
I20260808 18:38:38.134641 6045 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:38.134701 6045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:38.134872 6045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:38.136828 6045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "cfb460617779bb52165feb9b70b8efcf"
server_key_iv: "b6388f00801c731571debe0c6e51d178"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.137348 6045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "cfb460617779bb52165feb9b70b8efcf"
server_key_iv: "b6388f00801c731571debe0c6e51d178"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.140925 6045 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:38.143186 6062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.144356 6045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:38.144456 6045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "cfb460617779bb52165feb9b70b8efcf"
server_key_iv: "b6388f00801c731571debe0c6e51d178"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.144541 6045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:38.157068 6045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:38.159699 6045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:38.159852 6045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:38.167829 6045 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:33963
I20260808 18:38:38.167832 6147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:33963 every 8 connection(s)
I20260808 18:38:38.168751 6045 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:38.171603 6148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:38.174613 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6045
I20260808 18:38:38.174707 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:38.174932 4343 external_mini_cluster.cc:1428] Setting key e59e4a4b5d5391783c75c1b15a92c5e5
I20260808 18:38:38.177278 6148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Bootstrap starting.
I20260808 18:38:38.179700 6148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:38.180675 6148 log.cc:824] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:38.182862 6148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: No bootstrap required, opened a new log
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:38.186421 6148 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } }
I20260808 18:38:38.186673 6148 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:38.186731 6148 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe6cdd92fa8453ba525d1e5738e5b5a, State: Initialized, Role: FOLLOWER
I20260808 18:38:38.187182 6148 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } }
I20260808 18:38:38.187320 6148 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:38.187384 6148 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:38.187487 6148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:38.188362 6148 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } }
I20260808 18:38:38.188442 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.176285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.4.61.254:33963)
0808 18:38:38.176685 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.176701 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.176734 (+ 33us) server_negotiation.cc:407] Connection header received
0808 18:38:38.177332 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.177349 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.177687 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.177974 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.178855 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.179831 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.180955 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.181422 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.181614 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.184043 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.184049 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.184063 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.184089 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.185642 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.186048 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.186053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.186058 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.186171 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.186478 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.186482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.186484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.186943 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.187144 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.187395 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.187692 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":110,"threads_started":1}
I20260808 18:38:38.188737 6148 leader_election.cc:302] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffe6cdd92fa8453ba525d1e5738e5b5a; no voters:
I20260808 18:38:38.189112 6148 leader_election.cc:288] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:38.189190 6154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:38.189394 6154 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [term 1 LEADER]: Becoming Leader. State: Replica: ffe6cdd92fa8453ba525d1e5738e5b5a, State: Running, Role: LEADER
I20260808 18:38:38.189697 6154 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } }
I20260808 18:38:38.190403 6148 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:38.191200 6155 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } } }
I20260808 18:38:38.191326 6155 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:38.191627 6157 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffe6cdd92fa8453ba525d1e5738e5b5a. Latest consensus state: current_term: 1 leader_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe6cdd92fa8453ba525d1e5738e5b5a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33963 } } }
I20260808 18:38:38.191711 6170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:38.191718 6157 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:38.194877 6170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:38.200469 6170 catalog_manager.cc:1347] Generated new cluster ID: 84227192f6ae45be8d1835992b8e0bad
I20260808 18:38:38.200536 6170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:38.218636 6170 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:38.219995 6170 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:38.225865 6170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Generated new TSK 0
I20260808 18:38:38.226742 6170 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:38.265380 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33963
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:38.381469 6190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:38.381736 6190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:38.381799 6190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:38.385748 6190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:38.385800 6190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:38.385854 6190 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:38.385908 6190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:38.391119 6190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:33963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:38.392223 6190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:38.393276 6190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:38:38.402792 6190 server_base.cc:1034] running on GCE node
W20260808 18:38:38.402753 6196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.402753 6198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.402756 6195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:38.403369 6190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:38.403988 6190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:38.405143 6190 hybrid_clock.cc:648] HybridClock initialized: now 1786214318405119 us; error 38 us; skew 500 ppm
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:38.407828 6190 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:38.408751 6190 webserver.cc:460] Webserver started at http://127.4.61.193:41585/ using document root <none> and password file <none>
I20260808 18:38:38.409277 6190 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:38.409334 6190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:38.409508 6190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:38.411551 6190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "7d822729d4964198a577f257b3955ba7"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "8d4a132eafc5263ea0138a48b34744c3"
server_key_iv: "181b86def5691393dd0947eebf9ca17a"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.412084 6190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "7d822729d4964198a577f257b3955ba7"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "8d4a132eafc5263ea0138a48b34744c3"
server_key_iv: "181b86def5691393dd0947eebf9ca17a"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.415833 6190 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:38:38.418157 6205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.419361 6190 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:38.419462 6190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "7d822729d4964198a577f257b3955ba7"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "8d4a132eafc5263ea0138a48b34744c3"
server_key_iv: "181b86def5691393dd0947eebf9ca17a"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.419567 6190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:38.447034 6190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:38.450145 6190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:38.450352 6190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:38.451983 6190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:38.452047 6190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.452103 6190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:38.452132 6190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:38.462476 6190 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:44761
I20260808 18:38:38.462536 6355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:44761 every 8 connection(s)
I20260808 18:38:38.463579 6190 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:38.466102 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.452828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:41383 (local address 127.4.61.254:33963)
0808 18:38:38.452992 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.452998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.453905 (+ 907us) server_negotiation.cc:407] Connection header received
0808 18:38:38.455140 (+ 1235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.455144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.455208 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.455299 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.456938 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.457561 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.458854 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.459212 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.459330 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.462540 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.462544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.462547 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.462575 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.464027 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.464607 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.464611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.464613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.464695 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.465019 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.465023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.465025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.465211 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.465296 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.465798 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.465936 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 18:38:38.466583 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6190
I20260808 18:38:38.466720 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:38.466958 6215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.453219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.193:41383)
0808 18:38:38.453716 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.453778 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.454855 (+ 1077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.455529 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.455540 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.456023 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.456747 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.456768 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.457688 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.457691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.458736 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.458747 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.459391 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.459396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.459589 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.460712 (+ 1123us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.460734 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.462357 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.464156 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.464162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.464176 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.464493 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.464777 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.464780 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.464782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.464917 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.465307 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.465314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.465565 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.465719 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.466024 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
I20260808 18:38:38.466987 4343 external_mini_cluster.cc:1428] Setting key a760390485ef0c148a39a062996d6ee9
I20260808 18:38:38.468485 6356 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33963
I20260808 18:38:38.468638 6356 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:38.469185 6356 heartbeater.cc:511] Master 127.4.61.254:33963 requested a full tablet report, sending...
I20260808 18:38:38.470849 6085 ts_manager.cc:194] Registered new tserver with Master: 7d822729d4964198a577f257b3955ba7 (127.4.61.193:44761)
I20260808 18:38:38.472172 6085 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:41383
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:38.479254 6364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.470626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.193:39259)
0808 18:38:38.470930 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.470945 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.471028 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.473071 (+ 2043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.473075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.473285 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.473393 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.473401 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.474440 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.474444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.474994 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.475003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.475530 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.475532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.475596 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.476080 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.476090 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.476376 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.478054 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.478057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.478058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.478230 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.478482 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.478484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.478486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.478553 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.478863 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.478865 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.478942 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.479019 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.479121 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":115,"threads_started":1}
I20260808 18:38:38.479259 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.472773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:39259 (local address 127.4.61.254:33963)
0808 18:38:38.472883 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.472887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.472898 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:38:38.472933 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.472936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.472969 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.473034 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.473518 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.474281 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.475105 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.475431 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.475539 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.476506 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.476510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.476513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.476540 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.477947 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.478304 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.478306 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.478307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.478414 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.478621 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.478624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.478625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.478798 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.478882 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.479063 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.479149 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:38.495103 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33963
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:38.607462 6367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:38.607740 6367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:38.607787 6367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:38.611809 6367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:38.611878 6367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:38.611922 6367 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:38.611974 6367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:38.617257 6367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:33963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:38.618392 6367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:38.619434 6367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:38.628943 6379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.628963 6382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.628957 6380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:38.629228 6367 server_base.cc:1034] running on GCE node
I20260808 18:38:38.629640 6367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:38.630267 6367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:38.631474 6367 hybrid_clock.cc:648] HybridClock initialized: now 1786214318631443 us; error 41 us; skew 500 ppm
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:38.634043 6367 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:38.634907 6367 webserver.cc:460] Webserver started at http://127.4.61.194:44263/ using document root <none> and password file <none>
I20260808 18:38:38.635452 6367 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:38.635519 6367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:38.635720 6367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:38.637778 6367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "fdba7771980f47259e8637c9a76b56cd"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "b441a1083212fa4c30808e5f7992a2a6"
server_key_iv: "9823e1aafc62677adb942c6a55016bb0"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.638378 6367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "fdba7771980f47259e8637c9a76b56cd"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "b441a1083212fa4c30808e5f7992a2a6"
server_key_iv: "9823e1aafc62677adb942c6a55016bb0"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.642107 6367 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:38:38.644573 6392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.645944 6367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:38.646066 6367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "fdba7771980f47259e8637c9a76b56cd"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "b441a1083212fa4c30808e5f7992a2a6"
server_key_iv: "9823e1aafc62677adb942c6a55016bb0"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.646178 6367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:38.667958 6367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:38.671209 6367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:38.671365 6367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:38.672801 6367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:38.672856 6367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.672925 6367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:38.672955 6367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:38.682673 6367 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:40577
I20260808 18:38:38.682717 6580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:40577 every 8 connection(s)
I20260808 18:38:38.683614 6367 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:38.686384 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.673578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:34877 (local address 127.4.61.254:33963)
0808 18:38:38.673721 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.673726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.674632 (+ 906us) server_negotiation.cc:407] Connection header received
0808 18:38:38.675746 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.675750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.675814 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.675917 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.677402 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.678226 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.679851 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.680183 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.680303 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.683149 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.683152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.683154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.683179 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.684655 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.685150 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.685153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.685154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.685226 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.685501 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.685503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.685504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.685668 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.685737 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.686138 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.686229 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:38:38.687180 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.673990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.194:34877)
0808 18:38:38.674474 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.674524 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.675473 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.676145 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.676154 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.676556 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.677226 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.677246 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.678379 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.678383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.679721 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.679731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.680321 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.680324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.680477 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.681102 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.681123 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.682983 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.684775 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.684780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.684793 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.685067 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.685287 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.685289 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.685291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.685431 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.685735 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.685739 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.685955 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.686096 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.686381 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":108,"threads_started":1}
I20260808 18:38:38.688354 6581 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33963
I20260808 18:38:38.688491 6581 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:38.688956 6581 heartbeater.cc:511] Master 127.4.61.254:33963 requested a full tablet report, sending...
I20260808 18:38:38.689913 6083 ts_manager.cc:194] Registered new tserver with Master: fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577)
I20260808 18:38:38.690590 6083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:34877
I20260808 18:38:38.691810 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6367
I20260808 18:38:38.691921 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:38.692214 4343 external_mini_cluster.cc:1428] Setting key 9e6b8b221838d0661aaaa47553b8888c
I20260808 18:38:38.697158 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.690259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.194:44235)
0808 18:38:38.690592 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.690603 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.690687 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.690933 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.690935 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.691134 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.691247 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.691254 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.692171 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.692174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.692841 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.692850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.693254 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.693258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.693344 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.693758 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.693771 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.694070 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.695765 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.695767 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.695769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.695949 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.696192 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.696194 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.696195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.696259 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.696772 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.696774 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.696847 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.696922 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.697022 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":118,"threads_started":1}
I20260808 18:38:38.697225 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.690365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:44235 (local address 127.4.61.254:33963)
0808 18:38:38.690468 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.690473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.690669 (+ 196us) server_negotiation.cc:407] Connection header received
0808 18:38:38.690763 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.690766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.690833 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.690895 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.691347 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.692049 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.692941 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.693160 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.693242 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.694193 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.694197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.694199 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.694223 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.695666 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.696031 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.696035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.696037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.696119 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.696327 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.696329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.696331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.696692 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.696788 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.696990 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.697094 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:38.716990 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33963
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:38.826473 6596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:38.826723 6596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:38.826783 6596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:38.830744 6596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:38.830808 6596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:38.830861 6596 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:38.830912 6596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:38.836253 6596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:33963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:38.837333 6596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:38.838420 6596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:38:38.848981 6596 server_base.cc:1034] running on GCE node
W20260808 18:38:38.848902 6607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.848917 6609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:38.848907 6605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:38.849653 6596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:38.850368 6596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:38.851559 6596 hybrid_clock.cc:648] HybridClock initialized: now 1786214318851539 us; error 30 us; skew 500 ppm
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:38.854203 6596 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:38.855155 6596 webserver.cc:460] Webserver started at http://127.4.61.195:42213/ using document root <none> and password file <none>
I20260808 18:38:38.855696 6596 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:38.855759 6596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:38.855979 6596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:38.858121 6596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "23e4f992ec944f4346273decbe2f281a"
server_key_iv: "435314b33ab7a9dfe78ca1f4f7190bd9"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.858742 6596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "23e4f992ec944f4346273decbe2f281a"
server_key_iv: "435314b33ab7a9dfe78ca1f4f7190bd9"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.862720 6596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:38:38.865368 6620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.866777 6596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:38:38.866909 6596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
format_stamp: "Formatted at 2026-08-08 18:38:38 on dist-test-slave-fgb3"
server_key: "23e4f992ec944f4346273decbe2f281a"
server_key_iv: "435314b33ab7a9dfe78ca1f4f7190bd9"
server_key_version: "encryptionkey@0"
I20260808 18:38:38.867030 6596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:38.881354 6596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:38.884284 6596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:38.884469 6596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:38.885973 6596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:38.886022 6596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:38.886065 6596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:38.886096 6596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:38.896494 6596 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:32859
I20260808 18:38:38.896854 6791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:32859 every 8 connection(s)
I20260808 18:38:38.897645 6596 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:38.900059 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.886880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50059 (local address 127.4.61.254:33963)
0808 18:38:38.887035 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.887040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.887925 (+ 885us) server_negotiation.cc:407] Connection header received
0808 18:38:38.889034 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.889037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.889095 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.889169 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.890690 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.891579 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.893070 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.893420 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.893531 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.896181 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.896186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.896188 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.896218 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.897793 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.898457 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.898461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.898463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.898564 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.898932 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.898936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.898938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.899144 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.899235 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.899761 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.899892 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 18:38:38.900842 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.887286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.195:50059)
0808 18:38:38.887758 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.887808 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.888814 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.889378 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.889388 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.889811 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.890514 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.890535 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.891715 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.891719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.892938 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.892948 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.893568 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.893571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.893713 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.894273 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.894295 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.896000 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.897911 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.897916 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.897928 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.898280 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.898664 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.898667 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.898670 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.898822 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.899251 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.899258 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.899513 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.899677 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.900021 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":111,"threads_started":1}
I20260808 18:38:38.901988 6792 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33963
I20260808 18:38:38.902138 6792 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:38.902704 6792 heartbeater.cc:511] Master 127.4.61.254:33963 requested a full tablet report, sending...
I20260808 18:38:38.902743 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6596
I20260808 18:38:38.902860 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:38.903187 4343 external_mini_cluster.cc:1428] Setting key 09ced3b8c6be65696c0d17c694050230
I20260808 18:38:38.903795 6085 ts_manager.cc:194] Registered new tserver with Master: cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:38.904544 6085 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:50059
I20260808 18:38:38.905258 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:38:38.912715 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.904394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:39017 (local address 127.4.61.254:33963)
0808 18:38:38.904513 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.904517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.905363 (+ 846us) server_negotiation.cc:407] Connection header received
0808 18:38:38.905554 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.905557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.905602 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.905649 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.906250 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.906967 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.908075 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.908289 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.908363 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.909491 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.909495 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.909498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.909524 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.911131 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.911567 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.911570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.911572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.911651 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.911928 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.911930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.911931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.912145 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.912244 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.912503 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.912599 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:38:38.912787 6803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.904400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.4.61.195:39017)
0808 18:38:38.905284 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.905298 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.905444 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.905782 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.905785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.906007 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:38.906121 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.906128 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.907106 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.907109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.907940 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.907951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.908408 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.908412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.908505 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.909019 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:38.909031 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:38.909350 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:38.911234 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.911237 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.911239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.911473 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.911739 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:38.911742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:38.911744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:38.911842 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:38.912240 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:38.912243 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:38.912344 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.912451 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.912593 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":647,"threads_started":1}
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 18:38:38 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:38.931603 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.924611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46496 (local address 127.4.61.254:33963)
0808 18:38:38.924723 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.924727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.924739 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:38:38.924775 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.924777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.924831 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.924899 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:38.925575 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.926079 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.926900 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.927105 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.927176 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.929261 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:38.929264 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:38.929266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:38.929290 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:38.930387 (+ 1097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.930736 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.930738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.930739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.930802 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:38.930987 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:38.930989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:38.930990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:38.931140 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:38.931227 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.931397 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.931484 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 18:38:38.934211 6083 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:38.937228 6083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:38.951268 6814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.945106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40577 (local address 127.0.0.1:42898)
0808 18:38:38.945413 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.945460 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.945578 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.946578 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.946585 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.946625 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:38.946769 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.946777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948244 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.948249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.949614 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.949624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.950696 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.950816 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.950861 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.950977 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.951106 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":5,"thread_start_us":67,"threads_started":1}
I20260808 18:38:38.951401 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.945275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:44761 (local address 127.0.0.1:56616)
0808 18:38:38.946059 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.946073 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.946161 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.947222 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.947225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.947245 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:38.947353 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.947360 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948714 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.948717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.949963 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.949971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.950959 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.951054 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.951078 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.951138 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.951206 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":98,"thread_start_us":117,"threads_started":1}
I20260808 18:38:38.951442 6819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.945931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:32859 (local address 127.0.0.1:45766)
0808 18:38:38.946141 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:38.946152 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:38.946247 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:38.947397 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:38.947400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:38.947417 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:38.947492 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.947499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948663 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.948667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.949929 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:38.949941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.951119 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.951123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:38.951200 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.951218 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 18:38:38.951276 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 18:38:38.951334 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":4,"thread_start_us":99,"threads_started":1}
I20260808 18:38:38.951467 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.946251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.4.61.193:44761)
0808 18:38:38.946750 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.946767 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.946791 (+ 24us) server_negotiation.cc:407] Connection header received
0808 18:38:38.946865 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.946870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.947083 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.947239 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:38.947488 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948562 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950175 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.950842 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950943 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.951104 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.951229 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.951321 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":139,"threads_started":1}
I20260808 18:38:38.951809 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.945258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.4.61.194:40577)
0808 18:38:38.945898 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.945911 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.945936 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:38:38.946020 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.946026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.946242 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.946449 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:38.946919 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948144 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.949747 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.950567 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950679 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.950851 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.951607 (+ 756us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.951702 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":132,"threads_started":1}
I20260808 18:38:38.951824 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:38.946425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45766 (local address 127.4.61.195:32859)
0808 18:38:38.946891 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:38.946904 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:38.946924 (+ 20us) server_negotiation.cc:407] Connection header received
0808 18:38:38.946995 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:38.947000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:38.947241 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:38.947402 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:38.947597 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.948555 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950063 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:38.950809 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:38.950907 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:38.951061 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:38.951589 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 18:38:38.951698 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":135,"threads_started":1}
I20260808 18:38:38.954520 6470 tablet_service.cc:1467] Processing CreateTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 (DEFAULT_TABLE table=test-table [id=6d6275aaffa54473a6c0b37e78525d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:38.954790 6690 tablet_service.cc:1467] Processing CreateTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 (DEFAULT_TABLE table=test-table [id=6d6275aaffa54473a6c0b37e78525d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:38.954679 6272 tablet_service.cc:1467] Processing CreateTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 (DEFAULT_TABLE table=test-table [id=6d6275aaffa54473a6c0b37e78525d81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:38.955513 6470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af06f96fb4f7482291bf3de09e2f7fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:38.955729 6690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af06f96fb4f7482291bf3de09e2f7fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:38.955722 6272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af06f96fb4f7482291bf3de09e2f7fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:38.962509 6822 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Bootstrap starting.
I20260808 18:38:38.964138 6824 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Bootstrap starting.
I20260808 18:38:38.964736 6822 tablet_bootstrap.cc:654] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:38.965442 6822 log.cc:824] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:38.965875 6824 tablet_bootstrap.cc:654] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:38.966675 6824 log.cc:824] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:38.967334 6823 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Bootstrap starting.
I20260808 18:38:38.967499 6822 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: No bootstrap required, opened a new log
I20260808 18:38:38.967701 6822 ts_tablet_manager.cc:1397] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:38:38.968906 6824 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: No bootstrap required, opened a new log
I20260808 18:38:38.969097 6824 ts_tablet_manager.cc:1397] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:38:38.969554 6823 tablet_bootstrap.cc:654] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:38.970420 6823 log.cc:824] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:38.971153 6822 raft_consensus.cc:348] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.971441 6822 raft_consensus.cc:374] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:38.971503 6822 raft_consensus.cc:729] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdba7771980f47259e8637c9a76b56cd, State: Initialized, Role: FOLLOWER
I20260808 18:38:38.971979 6822 consensus_queue.cc:260] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.972522 6823 tablet_bootstrap.cc:492] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: No bootstrap required, opened a new log
I20260808 18:38:38.972711 6823 ts_tablet_manager.cc:1397] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:38:38.972998 6822 ts_tablet_manager.cc:1428] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:38:38.972908 6824 raft_consensus.cc:348] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.973160 6824 raft_consensus.cc:374] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:38.973214 6824 raft_consensus.cc:729] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa9129c4d8e49028e7f5f7f6b4e1cc0, State: Initialized, Role: FOLLOWER
I20260808 18:38:38.973349 6581 heartbeater.cc:503] Master 127.4.61.254:33963 was elected leader, sending a full tablet report...
I20260808 18:38:38.973626 6824 consensus_queue.cc:260] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.974349 6792 heartbeater.cc:503] Master 127.4.61.254:33963 was elected leader, sending a full tablet report...
I20260808 18:38:38.974609 6824 ts_tablet_manager.cc:1428] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260808 18:38:38.976301 6823 raft_consensus.cc:348] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.976578 6823 raft_consensus.cc:374] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:38.976640 6823 raft_consensus.cc:729] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d822729d4964198a577f257b3955ba7, State: Initialized, Role: FOLLOWER
I20260808 18:38:38.977072 6823 consensus_queue.cc:260] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:38.977747 6356 heartbeater.cc:503] Master 127.4.61.254:33963 was elected leader, sending a full tablet report...
I20260808 18:38:38.978808 6823 ts_tablet_manager.cc:1428] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:38:38.999138 6833 raft_consensus.cc:482] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:38.999325 6833 raft_consensus.cc:504] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.000406 6833 leader_election.cc:288] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.005471 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.001037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:44191 (local address 127.4.61.194:40577)
0808 18:38:39.001161 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.001165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.001177 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:38:39.001221 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.001223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.001265 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.001320 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:39.001590 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.002451 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004182 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.004804 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004930 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.004989 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.005264 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.005333 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:38:39.005471 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.001056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:52211 (local address 127.4.61.195:32859)
0808 18:38:39.001180 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.001183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.001255 (+ 72us) server_negotiation.cc:407] Connection header received
0808 18:38:39.001426 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.001430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.001476 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.001531 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:39.001751 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.002484 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004179 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.004804 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004930 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.004989 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.005261 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.005333 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:38:39.005534 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.000604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40577 (local address 127.4.61.193:44191)
0808 18:38:39.000868 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.000884 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.000984 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.001348 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.001351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.001367 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:39.001482 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.001487 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.002566 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.002570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.004065 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.004077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.004932 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.005098 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.005160 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.005234 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.005340 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":130,"thread_start_us":98,"threads_started":1}
I20260808 18:38:39.005851 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.000703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:32859 (local address 127.4.61.193:52211)
0808 18:38:39.000935 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.000949 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.001300 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.001558 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.001561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.001578 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:39.001662 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.001666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.002576 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.002579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.004065 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.004077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.004932 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.004936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.005120 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.005167 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.005238 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.005343 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":207,"thread_start_us":77,"threads_started":1}
I20260808 18:38:39.006295 6506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af06f96fb4f7482291bf3de09e2f7fd2" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdba7771980f47259e8637c9a76b56cd" is_pre_election: true
I20260808 18:38:39.006448 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af06f96fb4f7482291bf3de09e2f7fd2" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" is_pre_election: true
I20260808 18:38:39.006675 6506 raft_consensus.cc:2454] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 0.
I20260808 18:38:39.006734 6724 raft_consensus.cc:2454] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 0.
I20260808 18:38:39.007202 6209 leader_election.cc:302] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d822729d4964198a577f257b3955ba7, fdba7771980f47259e8637c9a76b56cd; no voters:
I20260808 18:38:39.007519 6833 raft_consensus.cc:2781] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:39.007599 6833 raft_consensus.cc:482] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:39.007628 6833 raft_consensus.cc:3037] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.008648 6833 raft_consensus.cc:504] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.008970 6833 leader_election.cc:288] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 election: Requested vote from peers fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.009303 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af06f96fb4f7482291bf3de09e2f7fd2" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
I20260808 18:38:39.009429 6724 raft_consensus.cc:3037] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.010462 6506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af06f96fb4f7482291bf3de09e2f7fd2" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdba7771980f47259e8637c9a76b56cd"
I20260808 18:38:39.010596 6506 raft_consensus.cc:3037] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.010689 6724 raft_consensus.cc:2454] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 1.
I20260808 18:38:39.010980 6207 leader_election.cc:302] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d822729d4964198a577f257b3955ba7, cfa9129c4d8e49028e7f5f7f6b4e1cc0; no voters:
I20260808 18:38:39.011155 6833 raft_consensus.cc:2781] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:39.011356 6833 raft_consensus.cc:686] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 1 LEADER]: Becoming Leader. State: Replica: 7d822729d4964198a577f257b3955ba7, State: Running, Role: LEADER
I20260808 18:38:39.011710 6833 consensus_queue.cc:237] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.012192 6506 raft_consensus.cc:2454] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 1.
I20260808 18:38:39.015035 6083 catalog_manager.cc:5495] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d822729d4964198a577f257b3955ba7 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "7d822729d4964198a577f257b3955ba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:39.040509 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.037181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56624 (local address 127.4.61.193:44761)
0808 18:38:39.037320 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.037324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.037338 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:38:39.037503 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.037506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.037563 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.037644 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:39.037850 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.038413 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.039206 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.039407 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.039475 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.039719 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.040119 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.040194 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.040288 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.040342 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 18:38:39.046761 6724 raft_consensus.cc:1261] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Refusing update from remote peer 7d822729d4964198a577f257b3955ba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.047533 6836 consensus_queue.cc:1035] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.048750 6506 raft_consensus.cc:1261] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Refusing update from remote peer 7d822729d4964198a577f257b3955ba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.049402 6833 consensus_queue.cc:1035] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.056911 6841 mvcc.cc:205] Tried to move back new op lower bound from 7316333850806288384 to 7316333850675044352. Current Snapshot: MvccSnapshot[applied={T|T < 7316333850806288384}]
I20260808 18:38:39.057849 6842 mvcc.cc:205] Tried to move back new op lower bound from 7316333850806288384 to 7316333850675044352. Current Snapshot: MvccSnapshot[applied={T|T < 7316333850806288384}]
I20260808 18:38:39.058892 6844 mvcc.cc:205] Tried to move back new op lower bound from 7316333850806288384 to 7316333850675044352. Current Snapshot: MvccSnapshot[applied={T|T < 7316333850806288384}]
I20260808 18:38:39.068305 6083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:39.068599 6083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:39.071408 6083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Sending DeleteTablet for 3 replicas of tablet af06f96fb4f7482291bf3de09e2f7fd2
I20260808 18:38:39.072295 6470 tablet_service.cc:1514] Processing DeleteTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:42898
I20260808 18:38:39.072444 6272 tablet_service.cc:1514] Processing DeleteTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:56616
I20260808 18:38:39.072952 6853 tablet_replica.cc:330] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: stopping tablet replica
I20260808 18:38:39.073123 6690 tablet_service.cc:1514] Processing DeleteTablet for tablet af06f96fb4f7482291bf3de09e2f7fd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45766
I20260808 18:38:39.073314 6853 raft_consensus.cc:2229] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:39.073235 6083 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 18:38:39.073673 6853 raft_consensus.cc:2258] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 18:38:39.073664 6083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:39.073961 6854 tablet_replica.cc:330] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: stopping tablet replica
I20260808 18:38:39.074211 6855 tablet_replica.cc:330] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: stopping tablet replica
I20260808 18:38:39.074424 6854 raft_consensus.cc:2229] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:39.074548 6855 raft_consensus.cc:2229] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:39.074944 6854 raft_consensus.cc:2258] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:39.076478 6854 ts_tablet_manager.cc:1905] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.077783 6853 ts_tablet_manager.cc:1905] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.078814 6272 tablet_service.cc:1467] Processing CreateTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 (DEFAULT_TABLE table=test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:39.078824 6470 tablet_service.cc:1467] Processing CreateTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 (DEFAULT_TABLE table=test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:39.079079 6272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efacb8ce357b4922ae67c17b5fa3a9b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.079084 6470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efacb8ce357b4922ae67c17b5fa3a9b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.081058 6822 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Bootstrap starting.
I20260808 18:38:39.081681 6823 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Bootstrap starting.
I20260808 18:38:39.082067 6822 tablet_bootstrap.cc:654] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.082610 6823 tablet_bootstrap.cc:654] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.083323 6853 ts_tablet_manager.cc:1918] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:39.083441 6853 log.cc:1196] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/af06f96fb4f7482291bf3de09e2f7fd2
I20260808 18:38:39.083630 6690 tablet_service.cc:1467] Processing CreateTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 (DEFAULT_TABLE table=test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:39.083752 6853 ts_tablet_manager.cc:1939] T af06f96fb4f7482291bf3de09e2f7fd2 P fdba7771980f47259e8637c9a76b56cd: Deleting consensus metadata
I20260808 18:38:39.083907 6690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efacb8ce357b4922ae67c17b5fa3a9b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.084841 6855 raft_consensus.cc:2258] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:39.084913 6069 catalog_manager.cc:4841] TS fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577): tablet af06f96fb4f7482291bf3de09e2f7fd2 (table test-table [id=6d6275aaffa54473a6c0b37e78525d81]) successfully deleted
I20260808 18:38:39.085840 6823 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: No bootstrap required, opened a new log
I20260808 18:38:39.085940 6823 ts_tablet_manager.cc:1397] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 18:38:39.085986 6822 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: No bootstrap required, opened a new log
I20260808 18:38:39.086053 6822 ts_tablet_manager.cc:1397] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 18:38:39.086289 6824 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Bootstrap starting.
I20260808 18:38:39.086489 6822 raft_consensus.cc:348] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.086601 6822 raft_consensus.cc:374] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.086634 6822 raft_consensus.cc:729] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdba7771980f47259e8637c9a76b56cd, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.086634 6823 raft_consensus.cc:348] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.086726 6823 raft_consensus.cc:374] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.086755 6823 raft_consensus.cc:729] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d822729d4964198a577f257b3955ba7, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.086758 6822 consensus_queue.cc:260] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.086861 6823 consensus_queue.cc:260] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.087002 6822 ts_tablet_manager.cc:1428] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:39.087106 6823 ts_tablet_manager.cc:1428] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:39.087311 6824 tablet_bootstrap.cc:654] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.089577 6855 ts_tablet_manager.cc:1905] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.092240 6855 ts_tablet_manager.cc:1918] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:39.092339 6855 log.cc:1196] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/af06f96fb4f7482291bf3de09e2f7fd2
I20260808 18:38:39.092638 6855 ts_tablet_manager.cc:1939] T af06f96fb4f7482291bf3de09e2f7fd2 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting consensus metadata
I20260808 18:38:39.093852 6065 catalog_manager.cc:4841] TS cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859): tablet af06f96fb4f7482291bf3de09e2f7fd2 (table test-table [id=6d6275aaffa54473a6c0b37e78525d81]) successfully deleted
I20260808 18:38:39.094632 6854 ts_tablet_manager.cc:1918] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:39.094735 6854 log.cc:1196] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/af06f96fb4f7482291bf3de09e2f7fd2
I20260808 18:38:39.095009 6824 tablet_bootstrap.cc:492] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: No bootstrap required, opened a new log
I20260808 18:38:39.095041 6854 ts_tablet_manager.cc:1939] T af06f96fb4f7482291bf3de09e2f7fd2 P 7d822729d4964198a577f257b3955ba7: Deleting consensus metadata
I20260808 18:38:39.095104 6824 ts_tablet_manager.cc:1397] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260808 18:38:39.095492 6824 raft_consensus.cc:348] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.095587 6824 raft_consensus.cc:374] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.095618 6824 raft_consensus.cc:729] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa9129c4d8e49028e7f5f7f6b4e1cc0, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.095738 6824 consensus_queue.cc:260] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.095994 6824 ts_tablet_manager.cc:1428] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 18:38:39.096150 6065 catalog_manager.cc:4841] TS 7d822729d4964198a577f257b3955ba7 (127.4.61.193:44761): tablet af06f96fb4f7482291bf3de09e2f7fd2 (table test-table [id=6d6275aaffa54473a6c0b37e78525d81]) successfully deleted
W20260808 18:38:39.148890 6794 tablet.cc:2369] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:39.159221 6836 raft_consensus.cc:482] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:39.159379 6836 raft_consensus.cc:504] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.159893 6836 leader_election.cc:288] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.160383 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efacb8ce357b4922ae67c17b5fa3a9b1" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" is_pre_election: true
I20260808 18:38:39.160383 6506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efacb8ce357b4922ae67c17b5fa3a9b1" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdba7771980f47259e8637c9a76b56cd" is_pre_election: true
I20260808 18:38:39.160559 6724 raft_consensus.cc:2454] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 0.
I20260808 18:38:39.160564 6506 raft_consensus.cc:2454] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 0.
I20260808 18:38:39.160907 6209 leader_election.cc:302] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7d822729d4964198a577f257b3955ba7, cfa9129c4d8e49028e7f5f7f6b4e1cc0, fdba7771980f47259e8637c9a76b56cd; no voters:
I20260808 18:38:39.161109 6836 raft_consensus.cc:2781] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:39.161163 6836 raft_consensus.cc:482] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:39.161204 6836 raft_consensus.cc:3037] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.162240 6836 raft_consensus.cc:504] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.162643 6836 leader_election.cc:288] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 election: Requested vote from peers fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.162987 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efacb8ce357b4922ae67c17b5fa3a9b1" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
I20260808 18:38:39.163023 6506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efacb8ce357b4922ae67c17b5fa3a9b1" candidate_uuid: "7d822729d4964198a577f257b3955ba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdba7771980f47259e8637c9a76b56cd"
I20260808 18:38:39.163091 6724 raft_consensus.cc:3037] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.163136 6506 raft_consensus.cc:3037] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.163964 6724 raft_consensus.cc:2454] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 1.
I20260808 18:38:39.164238 6207 leader_election.cc:302] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d822729d4964198a577f257b3955ba7, cfa9129c4d8e49028e7f5f7f6b4e1cc0; no voters:
I20260808 18:38:39.164301 6506 raft_consensus.cc:2454] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d822729d4964198a577f257b3955ba7 in term 1.
I20260808 18:38:39.164426 6836 raft_consensus.cc:2781] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:39.164763 6836 raft_consensus.cc:686] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 1 LEADER]: Becoming Leader. State: Replica: 7d822729d4964198a577f257b3955ba7, State: Running, Role: LEADER
I20260808 18:38:39.164912 6836 consensus_queue.cc:237] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.166776 6085 catalog_manager.cc:5495] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d822729d4964198a577f257b3955ba7 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "7d822729d4964198a577f257b3955ba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } health_report { overall_health: UNKNOWN } } }
W20260808 18:38:39.184708 6582 tablet.cc:2369] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 18:38:39 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
W20260808 18:38:39.214815 6357 tablet.cc:2369] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:39.217783 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.208687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33963 (local address 127.0.0.1:46500)
0808 18:38:39.208985 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.209001 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.209110 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.209350 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.209352 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.209743 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:39.209842 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.209847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.210923 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.210926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.211479 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.211485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.212115 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.212117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.212193 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.212731 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:39.212743 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:39.214443 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:39.216265 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:39.216275 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:39.216280 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:39.216522 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:39.216760 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:39.216762 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:39.216763 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:39.216834 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:39.217255 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:39.217261 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:39.217382 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.217488 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.217633 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":3,"thread_start_us":94,"threads_started":1}
I20260808 18:38:39.217895 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.208794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.4.61.254:33963)
0808 18:38:39.208949 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.208954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.209076 (+ 122us) server_negotiation.cc:407] Connection header received
0808 18:38:39.209185 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.209188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.209236 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.209336 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:39.209978 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.210830 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.211588 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.212001 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.212181 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.214577 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:39.214581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:39.214584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:39.214609 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:39.216153 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.216602 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.216605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.216607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.216687 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.216899 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.216902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.216904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.217114 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:39.217202 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.217541 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.217703 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":62}
I20260808 18:38:39.222153 6085 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:46500:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 18:38:39.223079 6085 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:39.228179 6272 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3b54d51cd43829ae91b30c126184d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d5eaae023094ab4b9eaf2e746619858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:39.228286 6470 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3b54d51cd43829ae91b30c126184d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d5eaae023094ab4b9eaf2e746619858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:39.228354 6690 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3b54d51cd43829ae91b30c126184d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d5eaae023094ab4b9eaf2e746619858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:39.228658 6272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3b54d51cd43829ae91b30c126184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.228699 6470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3b54d51cd43829ae91b30c126184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.228699 6690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3b54d51cd43829ae91b30c126184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:39.231178 6823 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: Bootstrap starting.
I20260808 18:38:39.232059 6823 tablet_bootstrap.cc:654] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.232234 6822 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: Bootstrap starting.
I20260808 18:38:39.232808 6824 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Bootstrap starting.
I20260808 18:38:39.233042 6822 tablet_bootstrap.cc:654] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.233438 6823 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: No bootstrap required, opened a new log
I20260808 18:38:39.233532 6823 ts_tablet_manager.cc:1397] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:39.233693 6824 tablet_bootstrap.cc:654] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:39.233923 6823 raft_consensus.cc:348] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.234025 6823 raft_consensus.cc:374] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.234045 6823 raft_consensus.cc:729] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d822729d4964198a577f257b3955ba7, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.234171 6823 consensus_queue.cc:260] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.234457 6823 ts_tablet_manager.cc:1428] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:39.234483 6836 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.234612 6836 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.235199 6822 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: No bootstrap required, opened a new log
I20260808 18:38:39.235280 6822 ts_tablet_manager.cc:1397] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:39.235431 6824 tablet_bootstrap.cc:492] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: No bootstrap required, opened a new log
I20260808 18:38:39.235512 6824 ts_tablet_manager.cc:1397] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 18:38:39.235641 6822 raft_consensus.cc:348] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.235728 6822 raft_consensus.cc:374] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.235747 6822 raft_consensus.cc:729] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdba7771980f47259e8637c9a76b56cd, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.235863 6822 consensus_queue.cc:260] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.235954 6824 raft_consensus.cc:348] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.236064 6824 raft_consensus.cc:374] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:39.236099 6824 raft_consensus.cc:729] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa9129c4d8e49028e7f5f7f6b4e1cc0, State: Initialized, Role: FOLLOWER
I20260808 18:38:39.236102 6822 ts_tablet_manager.cc:1428] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:38:39.236076 6829 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.236233 6829 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.236214 6824 consensus_queue.cc:260] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.236486 6824 ts_tablet_manager.cc:1428] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:39.236495 6832 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.236795 6832 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.279433 6829 raft_consensus.cc:482] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:39.279603 6829 raft_consensus.cc:504] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.280819 6829 leader_election.cc:288] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d822729d4964198a577f257b3955ba7 (127.4.61.193:44761), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.285240 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.281596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:41109 (local address 127.4.61.195:32859)
0808 18:38:39.281739 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.281744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.281978 (+ 234us) server_negotiation.cc:407] Connection header received
0808 18:38:39.282124 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.282127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.282173 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.282233 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:39.282595 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.283194 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284282 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.284735 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284837 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.284894 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.285062 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.285128 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 18:38:39.285260 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.281457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:32859 (local address 127.4.61.194:41109)
0808 18:38:39.281738 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.281749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.282023 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.282257 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.282259 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.282276 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:39.282463 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.282470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.283326 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.283329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.284180 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.284190 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.284837 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.284939 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.284965 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.285034 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.285104 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":58,"thread_start_us":71,"threads_started":1}
I20260808 18:38:39.285431 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.281170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:54995 (local address 127.4.61.193:44761)
0808 18:38:39.281347 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.281354 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.281632 (+ 278us) server_negotiation.cc:407] Connection header received
0808 18:38:39.281933 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.281939 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.281999 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.282054 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:39.282568 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.283251 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284377 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.284869 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284990 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.285052 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.285230 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.285306 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 18:38:39.285523 6879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.281044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:44761 (local address 127.4.61.194:54995)
0808 18:38:39.281345 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.281362 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.281750 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.282217 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.282220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.282237 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:39.282457 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.282469 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.283359 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.283362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.284248 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.284258 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.284990 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.284995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.285099 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.285126 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.285213 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.285284 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":65,"thread_start_us":115,"threads_started":1}
I20260808 18:38:39.286243 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3b54d51cd43829ae91b30c126184d" candidate_uuid: "fdba7771980f47259e8637c9a76b56cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" is_pre_election: true
I20260808 18:38:39.286307 6298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3b54d51cd43829ae91b30c126184d" candidate_uuid: "fdba7771980f47259e8637c9a76b56cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d822729d4964198a577f257b3955ba7" is_pre_election: true
I20260808 18:38:39.286450 6724 raft_consensus.cc:2454] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdba7771980f47259e8637c9a76b56cd in term 0.
I20260808 18:38:39.286573 6298 raft_consensus.cc:2454] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdba7771980f47259e8637c9a76b56cd in term 0.
I20260808 18:38:39.286794 6396 leader_election.cc:302] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfa9129c4d8e49028e7f5f7f6b4e1cc0, fdba7771980f47259e8637c9a76b56cd; no voters:
I20260808 18:38:39.287037 6829 raft_consensus.cc:2781] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:39.287101 6829 raft_consensus.cc:482] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:39.287137 6829 raft_consensus.cc:3037] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.288177 6829 raft_consensus.cc:504] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.288506 6829 leader_election.cc:288] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [CANDIDATE]: Term 1 election: Requested vote from peers 7d822729d4964198a577f257b3955ba7 (127.4.61.193:44761), cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859)
I20260808 18:38:39.288831 6298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3b54d51cd43829ae91b30c126184d" candidate_uuid: "fdba7771980f47259e8637c9a76b56cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d822729d4964198a577f257b3955ba7"
I20260808 18:38:39.288846 6724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3b54d51cd43829ae91b30c126184d" candidate_uuid: "fdba7771980f47259e8637c9a76b56cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0"
I20260808 18:38:39.288961 6724 raft_consensus.cc:3037] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.288961 6298 raft_consensus.cc:3037] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:39.290167 6298 raft_consensus.cc:2454] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdba7771980f47259e8637c9a76b56cd in term 1.
I20260808 18:38:39.290462 6396 leader_election.cc:302] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d822729d4964198a577f257b3955ba7, fdba7771980f47259e8637c9a76b56cd; no voters:
I20260808 18:38:39.290596 6724 raft_consensus.cc:2454] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdba7771980f47259e8637c9a76b56cd in term 1.
I20260808 18:38:39.290663 6829 raft_consensus.cc:2781] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:39.290830 6829 raft_consensus.cc:686] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [term 1 LEADER]: Becoming Leader. State: Replica: fdba7771980f47259e8637c9a76b56cd, State: Running, Role: LEADER
I20260808 18:38:39.291090 6829 consensus_queue.cc:237] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } }
I20260808 18:38:39.292502 6882 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: TxnStatusTablet state changed. Reason: New leader fdba7771980f47259e8637c9a76b56cd. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.292616 6882 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:39.292927 6889 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 18:38:39.293113 6889 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 18:38:39.293668 6083 catalog_manager.cc:5495] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd reported cstate change: term changed from 0 to 1, leader changed from <none> to fdba7771980f47259e8637c9a76b56cd (127.4.61.194). New cstate: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:39.321995 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.317276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.4.61.194:40577)
0808 18:38:39.317978 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.317983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.317998 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:38:39.318072 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.318075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.318138 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.318251 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:39.318550 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.319334 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.320492 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.320727 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.320827 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.321223 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.321658 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.321743 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.321830 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.321878 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595}
I20260808 18:38:39.322077 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.317169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40577 (local address 127.0.0.1:42902)
0808 18:38:39.317403 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.317417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.317532 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.318281 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.318284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.318294 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:39.318432 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.318440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.319466 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.319470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.320371 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.320382 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.320874 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.320879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.320993 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.321051 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.321738 (+ 687us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.321750 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.321820 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.321908 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260808 18:38:39.325018 6724 raft_consensus.cc:1261] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Refusing update from remote peer fdba7771980f47259e8637c9a76b56cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.325145 6298 raft_consensus.cc:1261] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Refusing update from remote peer fdba7771980f47259e8637c9a76b56cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.325482 6882 consensus_queue.cc:1035] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.325708 6829 consensus_queue.cc:1035] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.327126 6832 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: TxnStatusTablet state changed. Reason: New leader fdba7771980f47259e8637c9a76b56cd. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.327250 6832 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.328599 6836 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: TxnStatusTablet state changed. Reason: New leader fdba7771980f47259e8637c9a76b56cd. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.328713 6836 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.329185 6882 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.329284 6882 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:39.332067 6832 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.332175 6832 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P cfa9129c4d8e49028e7f5f7f6b4e1cc0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.332901 6882 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.332996 6882 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P fdba7771980f47259e8637c9a76b56cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:39.334509 6836 tablet_replica.cc:439] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdba7771980f47259e8637c9a76b56cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d822729d4964198a577f257b3955ba7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 44761 } } peers { permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 } } peers { permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 } } }
I20260808 18:38:39.334626 6836 tablet_replica.cc:442] T 52d3b54d51cd43829ae91b30c126184d P 7d822729d4964198a577f257b3955ba7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:39.343817 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.340585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:34075 (local address 127.4.61.194:40577)
0808 18:38:39.340760 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.340764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.340985 (+ 221us) server_negotiation.cc:407] Connection header received
0808 18:38:39.341119 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.341122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.341169 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.341225 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:39.341446 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.341958 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.342858 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.343085 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.343169 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.343429 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.343499 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.343556 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.343641 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.343688 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 18:38:39.343848 6902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.340484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40577 (local address 127.4.61.193:34075)
0808 18:38:39.340759 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.340774 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.341028 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.341243 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.341246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.341253 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:39.341357 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.341362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.342057 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.342061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.342751 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.342762 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.343180 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.343183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.343264 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.343308 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.343569 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.343575 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.343631 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.343717 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":89,"threads_started":1}
I20260808 18:38:39.350968 6506 raft_consensus.cc:1261] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Refusing update from remote peer 7d822729d4964198a577f257b3955ba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.350950 6724 raft_consensus.cc:1261] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Refusing update from remote peer 7d822729d4964198a577f257b3955ba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:39.351339 6833 consensus_queue.cc:1035] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdba7771980f47259e8637c9a76b56cd" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.351625 6836 consensus_queue.cc:1035] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa9129c4d8e49028e7f5f7f6b4e1cc0" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:39.373843 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.369931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:44761 (local address 127.4.61.194:48607)
0808 18:38:39.370341 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:39.370355 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:39.370610 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:39.370954 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:39.370957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:39.370966 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:39.371096 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.371104 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.371948 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.371951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.372729 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:39.372738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.373162 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.373166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:39.373254 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.373299 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.373564 (+ 265us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.373571 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:38:39.373627 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 18:38:39.373701 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":103,"threads_started":1}
I20260808 18:38:39.373831 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.370011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:48607 (local address 127.4.61.193:44761)
0808 18:38:39.370131 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.370135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.370568 (+ 433us) server_negotiation.cc:407] Connection header received
0808 18:38:39.370729 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.370732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.370783 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.370820 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:39.371221 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.371813 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.372833 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.373066 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.373154 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.373420 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:39.373495 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:39.373550 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.373636 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.373690 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:38:39.397426 6084 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:39.397578 6084 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:39.399536 6084 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ffe6cdd92fa8453ba525d1e5738e5b5a: Sending DeleteTablet for 3 replicas of tablet efacb8ce357b4922ae67c17b5fa3a9b1
I20260808 18:38:39.400149 6272 tablet_service.cc:1514] Processing DeleteTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:56616
I20260808 18:38:39.400244 6690 tablet_service.cc:1514] Processing DeleteTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45766
I20260808 18:38:39.400333 6854 tablet_replica.cc:330] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: stopping tablet replica
I20260808 18:38:39.400436 6854 raft_consensus.cc:2229] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:39.400590 6854 raft_consensus.cc:2258] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:39.400755 6855 tablet_replica.cc:330] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: stopping tablet replica
I20260808 18:38:39.400874 6855 raft_consensus.cc:2229] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:39.400997 6855 raft_consensus.cc:2258] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:39.401274 6854 ts_tablet_manager.cc:1905] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.401470 6470 tablet_service.cc:1514] Processing DeleteTablet for tablet efacb8ce357b4922ae67c17b5fa3a9b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:39 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:42898
I20260808 18:38:39.401645 6853 tablet_replica.cc:330] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: stopping tablet replica
I20260808 18:38:39.401700 6855 ts_tablet_manager.cc:1905] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.401741 6853 raft_consensus.cc:2229] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:39.401860 6853 raft_consensus.cc:2258] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:39.402623 6853 ts_tablet_manager.cc:1905] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:39.404176 6854 ts_tablet_manager.cc:1918] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:39.404244 6854 log.cc:1196] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/efacb8ce357b4922ae67c17b5fa3a9b1
I20260808 18:38:39.404408 6855 ts_tablet_manager.cc:1918] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:39.404477 6855 log.cc:1196] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/efacb8ce357b4922ae67c17b5fa3a9b1
I20260808 18:38:39.404502 6854 ts_tablet_manager.cc:1939] T efacb8ce357b4922ae67c17b5fa3a9b1 P 7d822729d4964198a577f257b3955ba7: Deleting consensus metadata
I20260808 18:38:39.404713 6855 ts_tablet_manager.cc:1939] T efacb8ce357b4922ae67c17b5fa3a9b1 P cfa9129c4d8e49028e7f5f7f6b4e1cc0: Deleting consensus metadata
I20260808 18:38:39.405181 6853 ts_tablet_manager.cc:1918] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:39.405247 6853 log.cc:1196] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/efacb8ce357b4922ae67c17b5fa3a9b1
I20260808 18:38:39.405208 6065 catalog_manager.cc:4841] TS 7d822729d4964198a577f257b3955ba7 (127.4.61.193:44761): tablet efacb8ce357b4922ae67c17b5fa3a9b1 (table test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]) successfully deleted
I20260808 18:38:39.405357 6065 catalog_manager.cc:4841] TS cfa9129c4d8e49028e7f5f7f6b4e1cc0 (127.4.61.195:32859): tablet efacb8ce357b4922ae67c17b5fa3a9b1 (table test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]) successfully deleted
I20260808 18:38:39.405470 6853 ts_tablet_manager.cc:1939] T efacb8ce357b4922ae67c17b5fa3a9b1 P fdba7771980f47259e8637c9a76b56cd: Deleting consensus metadata
I20260808 18:38:39.406049 6069 catalog_manager.cc:4841] TS fdba7771980f47259e8637c9a76b56cd (127.4.61.194:40577): tablet efacb8ce357b4922ae67c17b5fa3a9b1 (table test-table [id=3b3f8ff5bb3c4506a70f9b9661d5709d]) successfully deleted
Aug 08 18:38:39 dist-test-slave-fgb3 krb5kdc[6027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214318, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:39.416930 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.407169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56640 (local address 127.4.61.193:44761)
0808 18:38:39.407295 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.407300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.407520 (+ 220us) server_negotiation.cc:407] Connection header received
0808 18:38:39.407614 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.407617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.407668 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.407748 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:39.408374 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.409141 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.409887 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.410222 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.410378 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.413543 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:39.413553 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:39.413567 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:39.413590 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:39.415178 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.415671 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.415678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.415680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.415774 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.416052 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.416054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.416055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.416298 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:39.416468 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.416681 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.416785 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 18:38:39.417536 6348 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56640
I20260808 18:38:39.427192 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:39.419222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46516 (local address 127.4.61.254:33963)
0808 18:38:39.419371 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:39.419375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:39.419496 (+ 121us) server_negotiation.cc:407] Connection header received
0808 18:38:39.419622 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:39.419624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:39.419663 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:39.419723 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:39.420529 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.421044 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.422106 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:39.422429 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:39.422529 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:39.424146 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:39.424149 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:39.424151 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:39.424176 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:39.425470 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.425925 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.425927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.425928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.425994 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:39.426239 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:39.426241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:39.426242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:39.426476 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:39.426589 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:39.426896 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 18:38:39.427021 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 18:38:39.427660 6084 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46516
I20260808 18:38:39.429239 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6190
I20260808 18:38:39.445334 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6367
I20260808 18:38:39.463393 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6596
I20260808 18:38:39.475086 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6045
2026-08-08T18:38:39Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2745 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:39 dist-test-slave-fgb3 krb5kdc[6920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:39 dist-test-slave-fgb3 krb5kdc[6920](info): set up 2 sockets
Aug 08 18:38:39 dist-test-slave-fgb3 krb5kdc[6920](info): commencing operation
krb5kdc: starting...
W20260808 18:38:40.622613 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:40 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:40.748920 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43807
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:43807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:40.862807 6937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:40.863065 6937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:40.863118 6937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:40.867053 6937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:40.867106 6937 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 18:38:40.867130 6937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:40.867153 6937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:40.867188 6937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:40.867226 6937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:40.872418 6937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:43807
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:40.873518 6937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:40.874591 6937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:40.882863 6942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:40.882903 6950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:40.882892 6944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:40.883165 6937 server_base.cc:1034] running on GCE node
I20260808 18:38:40.883767 6937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:40.884833 6937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:40.886008 6937 hybrid_clock.cc:648] HybridClock initialized: now 1786214320885992 us; error 33 us; skew 500 ppm
Aug 08 18:38:40 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214320, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:40.888635 6937 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:40.889473 6937 webserver.cc:460] Webserver started at http://127.4.61.254:42415/ using document root <none> and password file <none>
I20260808 18:38:40.889986 6937 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:40.890051 6937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:40.890281 6937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:40.892274 6937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "3a259950863b4faea595dd4f93fbedcc"
format_stamp: "Formatted at 2026-08-08 18:38:40 on dist-test-slave-fgb3"
server_key: "89708da149e820222517f79f48e1b457"
server_key_iv: "52004b5ad2c9c1e6c6a34df3731cad3a"
server_key_version: "encryptionkey@0"
I20260808 18:38:40.892807 6937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "3a259950863b4faea595dd4f93fbedcc"
format_stamp: "Formatted at 2026-08-08 18:38:40 on dist-test-slave-fgb3"
server_key: "89708da149e820222517f79f48e1b457"
server_key_iv: "52004b5ad2c9c1e6c6a34df3731cad3a"
server_key_version: "encryptionkey@0"
I20260808 18:38:40.896310 6937 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 18:38:40.898557 6962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:40.899662 6937 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:38:40.899771 6937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "3a259950863b4faea595dd4f93fbedcc"
format_stamp: "Formatted at 2026-08-08 18:38:40 on dist-test-slave-fgb3"
server_key: "89708da149e820222517f79f48e1b457"
server_key_iv: "52004b5ad2c9c1e6c6a34df3731cad3a"
server_key_version: "encryptionkey@0"
I20260808 18:38:40.899863 6937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:40.912765 6937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:40.915304 6937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:40.915477 6937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:40.923036 6937 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:43807
I20260808 18:38:40.923053 7047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:43807 every 8 connection(s)
I20260808 18:38:40.923995 6937 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:40.925638 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6937
I20260808 18:38:40.925756 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:40.926002 4343 external_mini_cluster.cc:1428] Setting key a35aa78b63c20a080f3dddb562cb9e7d
I20260808 18:38:40.926975 7052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:40.933341 7052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Bootstrap starting.
Aug 08 18:38:40 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:40.935979 7052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:40.937094 7052 log.cc:824] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:40.939250 7052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: No bootstrap required, opened a new log
I20260808 18:38:40.940125 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:40.927318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42964 (local address 127.4.61.254:43807)
0808 18:38:40.927712 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:40.927727 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:40.927765 (+ 38us) server_negotiation.cc:407] Connection header received
0808 18:38:40.928399 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:40.928415 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:40.928733 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:40.929011 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:40.929898 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:40.930959 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:40.932123 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:40.932637 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:40.932759 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:40.935609 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:40.935614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:40.935628 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:40.935658 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:40.937413 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:40.937828 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:40.937835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:40.937840 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:40.937968 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:40.938238 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:40.938240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:40.938241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:40.938671 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:40.938826 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:40.939104 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 18:38:40.939384 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":112,"threads_started":1}
I20260808 18:38:40.942541 7052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } }
I20260808 18:38:40.942757 7052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:40.942808 7052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a259950863b4faea595dd4f93fbedcc, State: Initialized, Role: FOLLOWER
I20260808 18:38:40.943197 7052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } }
I20260808 18:38:40.943315 7052 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:40.943357 7052 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:40.943451 7052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:40.944275 7052 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } }
I20260808 18:38:40.944589 7052 leader_election.cc:302] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a259950863b4faea595dd4f93fbedcc; no voters:
I20260808 18:38:40.944868 7052 leader_election.cc:288] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:40.945019 7065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:40.945246 7065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [term 1 LEADER]: Becoming Leader. State: Replica: 3a259950863b4faea595dd4f93fbedcc, State: Running, Role: LEADER
I20260808 18:38:40.945569 7065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } }
I20260808 18:38:40.946039 7052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:40.947352 7066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a259950863b4faea595dd4f93fbedcc. Latest consensus state: current_term: 1 leader_uuid: "3a259950863b4faea595dd4f93fbedcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } } }
I20260808 18:38:40.947330 7067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a259950863b4faea595dd4f93fbedcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a259950863b4faea595dd4f93fbedcc" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43807 } } }
I20260808 18:38:40.947522 7066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:40.947522 7067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:40.947963 7083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:40.951319 7083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:40.956912 7083 catalog_manager.cc:1347] Generated new cluster ID: acaaa811be8843099b3750f92bce31e6
I20260808 18:38:40.956983 7083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:40.976640 7083 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:40.977974 7083 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:40.983289 7083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Generated new TSK 0
I20260808 18:38:40.983948 7083 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:41.018637 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43807
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:41.131574 7097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:41.131832 7097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:41.131889 7097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:41.135812 7097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:41.135865 7097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:41.135916 7097 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 18:38:41.135944 7097 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:41.135994 7097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:41.141252 7097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:41.142238 7097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:41.143258 7097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:41.152786 7104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:41.152832 7105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:41.152900 7097 server_base.cc:1034] running on GCE node
W20260808 18:38:41.152838 7107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:41.153406 7097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:41.154026 7097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:41.155177 7097 hybrid_clock.cc:648] HybridClock initialized: now 1786214321155149 us; error 39 us; skew 500 ppm
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:41.157723 7097 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:41.158568 7097 webserver.cc:460] Webserver started at http://127.4.61.193:44865/ using document root <none> and password file <none>
I20260808 18:38:41.159094 7097 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:41.159160 7097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:41.159364 7097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:41.161330 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "2c396c6deba64172babf46b28ad0e4d2"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "497e86af594f6381eb696ad00773622a"
server_key_iv: "97e328317306a74024796eb16302777b"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.161864 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "2c396c6deba64172babf46b28ad0e4d2"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "497e86af594f6381eb696ad00773622a"
server_key_iv: "97e328317306a74024796eb16302777b"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.165426 7097 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:41.167904 7116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.169036 7097 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:41.169140 7097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "2c396c6deba64172babf46b28ad0e4d2"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "497e86af594f6381eb696ad00773622a"
server_key_iv: "97e328317306a74024796eb16302777b"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.169229 7097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:41.189347 7097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:41.192523 7097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:41.192708 7097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:41.194164 7097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:41.194212 7097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.194267 7097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:41.194298 7097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:41.204191 7097 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:46297
I20260808 18:38:41.204367 7297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:46297 every 8 connection(s)
I20260808 18:38:41.205180 7097 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:41.207798 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.195020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:36179 (local address 127.4.61.254:43807)
0808 18:38:41.195175 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.195181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.196033 (+ 852us) server_negotiation.cc:407] Connection header received
0808 18:38:41.197093 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.197096 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.197155 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.197229 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.198765 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.199601 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.201264 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.201637 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.201757 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.204559 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.204563 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.204566 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.204591 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.206137 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.206613 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.206615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.206616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.206690 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.206934 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.206936 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.206937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.207102 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.207175 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.207575 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.207676 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:38:41.208519 7127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.195419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.193:36179)
0808 18:38:41.195875 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.195925 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.196831 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.197430 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.197438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.197874 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.198561 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.198583 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.199741 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.199745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.201140 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.201152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.201777 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.201779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.201932 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.202604 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.202626 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.204379 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.206217 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.206221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.206230 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.206534 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.206753 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.206755 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.206756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.206871 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.207174 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.207178 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.207392 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.207534 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.207764 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":109,"threads_started":1}
I20260808 18:38:41.209741 7298 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43807
I20260808 18:38:41.209877 7298 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:41.210367 7298 heartbeater.cc:511] Master 127.4.61.254:43807 requested a full tablet report, sending...
I20260808 18:38:41.211943 6985 ts_manager.cc:194] Registered new tserver with Master: 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297)
I20260808 18:38:41.213234 6985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:36179
I20260808 18:38:41.215260 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7097
I20260808 18:38:41.215390 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:41.215660 4343 external_mini_cluster.cc:1428] Setting key 6354ac85736549abc14340fa2d594800
I20260808 18:38:41.218473 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.211840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:54509 (local address 127.4.61.254:43807)
0808 18:38:41.211959 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.211963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.212102 (+ 139us) server_negotiation.cc:407] Connection header received
0808 18:38:41.212212 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.212215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.212251 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.212309 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.212744 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.213222 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.214245 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.214585 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.214701 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.215710 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.215714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.215716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.215741 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.217011 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.217430 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.217432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.217434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.217503 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.217738 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.217740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.217741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.217878 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.217963 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.218194 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.218283 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:38:41.218482 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.211758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.193:54509)
0808 18:38:41.212033 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.212048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.212139 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.212340 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.212343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.212542 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.212651 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.212659 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.213335 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.213339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.214140 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.214149 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.214698 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.214700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.214772 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.215191 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.215205 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.215583 (+ 378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.217105 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.217108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.217111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.217345 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.217576 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.217578 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.217580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.217666 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.217948 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.217961 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.218053 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.218152 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.218273 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":1,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:41.240878 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43807
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:41.351660 7316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:41.351919 7316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:41.351974 7316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:41.356197 7316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:41.356258 7316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:41.356312 7316 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 18:38:41.356351 7316 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:41.356405 7316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:41.361709 7316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:41.362707 7316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:41.363682 7316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:41.372884 7326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:41.372905 7316 server_base.cc:1034] running on GCE node
W20260808 18:38:41.372915 7321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:41.373060 7322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:41.373456 7316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:41.374081 7316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:41.375236 7316 hybrid_clock.cc:648] HybridClock initialized: now 1786214321375203 us; error 40 us; skew 500 ppm
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:41.377722 7316 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:41.378579 7316 webserver.cc:460] Webserver started at http://127.4.61.194:35187/ using document root <none> and password file <none>
I20260808 18:38:41.379087 7316 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:41.379143 7316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:41.379302 7316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:41.381274 7316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "9b5e74a93e81409087e99543ec40e1ef"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "bc9a02ff55ee0eede8e60b1f36fef47e"
server_key_iv: "8e3aeb3022bb0a214a13214d1c92e8fe"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.381848 7316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "9b5e74a93e81409087e99543ec40e1ef"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "bc9a02ff55ee0eede8e60b1f36fef47e"
server_key_iv: "8e3aeb3022bb0a214a13214d1c92e8fe"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.385380 7316 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:41.387814 7335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.388988 7316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:41.389093 7316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "9b5e74a93e81409087e99543ec40e1ef"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "bc9a02ff55ee0eede8e60b1f36fef47e"
server_key_iv: "8e3aeb3022bb0a214a13214d1c92e8fe"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.389184 7316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:41.404933 7316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:41.408195 7316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:41.408377 7316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:41.409860 7316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:41.409909 7316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.409974 7316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:41.409998 7316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.420742 7316 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:32977
I20260808 18:38:41.420799 7523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:32977 every 8 connection(s)
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:41.421767 7316 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:41.425356 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.412437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:38213 (local address 127.4.61.254:43807)
0808 18:38:41.412577 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.412582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.412650 (+ 68us) server_negotiation.cc:407] Connection header received
0808 18:38:41.413959 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.413963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.414032 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.414109 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.416333 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.417165 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.418947 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.419264 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.419382 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.422172 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.422176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.422179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.422215 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.423693 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.424143 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.424145 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.424147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.424216 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.424479 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.424481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.424482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.424650 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.424716 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.425132 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.425235 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:38:41.426167 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.411294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.194:38213)
0808 18:38:41.412512 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.412568 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.413690 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.414308 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.414339 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.415199 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.416183 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.416205 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.417332 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.417336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.418822 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.418835 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.419438 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.419443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.419660 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.420256 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.420277 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.421985 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.423800 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.423805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.423817 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.424064 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.424279 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.424280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.424282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.424402 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.424717 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.424721 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.424950 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.425101 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.425352 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"thread_start_us":118,"threads_started":1}
I20260808 18:38:41.426571 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7316
I20260808 18:38:41.426712 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:41.427047 4343 external_mini_cluster.cc:1428] Setting key 96b028d57fc424c7c2cc21351cd4de54
I20260808 18:38:41.430604 7526 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43807
I20260808 18:38:41.430773 7526 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:41.431303 7526 heartbeater.cc:511] Master 127.4.61.254:43807 requested a full tablet report, sending...
I20260808 18:38:41.432552 6986 ts_manager.cc:194] Registered new tserver with Master: 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977)
I20260808 18:38:41.433331 6986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:38213
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:41.443332 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.433444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49285 (local address 127.4.61.254:43807)
0808 18:38:41.433559 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.433564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.434189 (+ 625us) server_negotiation.cc:407] Connection header received
0808 18:38:41.434393 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.434396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.434443 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.434493 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.435102 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.435810 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.437288 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.437547 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.437604 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.439781 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.439786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.439788 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.439816 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.441423 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.441893 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.441897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.441899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.441985 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.442361 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.442364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.442366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.442658 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.442735 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.443062 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.443174 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:38:41.443338 7535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.433756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.194:49285)
0808 18:38:41.434099 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.434113 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.434267 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.434636 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.434639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.434844 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.434976 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.434983 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.435981 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.435984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.437168 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.437180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.437733 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.437735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.437809 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.439125 (+ 1316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.439140 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.439603 (+ 463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.441547 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.441551 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.441553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.441806 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.442100 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.442104 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.442106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.442202 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.442809 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.442812 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.442899 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.442984 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.443132 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:41.465962 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43807
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:41.582890 7538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:41.583166 7538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:41.583235 7538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:41.587287 7538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:41.587343 7538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:41.587399 7538 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 18:38:41.587428 7538 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:38:41.587476 7538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:41.592689 7538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:41.593727 7538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:41.594743 7538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:38:41.603953 7538 server_base.cc:1034] running on GCE node
W20260808 18:38:41.603853 7551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:41.603881 7549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:41.603881 7554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:41.604489 7538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:41.605028 7538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:41.606180 7538 hybrid_clock.cc:648] HybridClock initialized: now 1786214321606162 us; error 27 us; skew 500 ppm
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:41.612442 7538 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:41.613257 7538 webserver.cc:460] Webserver started at http://127.4.61.195:42477/ using document root <none> and password file <none>
I20260808 18:38:41.613770 7538 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:41.613826 7538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:41.613994 7538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:41.615965 7538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "9d108561b5c7426abda45699d81c1271"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "62f51ae76a0923114b3f598e9241e4c7"
server_key_iv: "43cee37b56a6474880349b1076c2fa07"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.616479 7538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "9d108561b5c7426abda45699d81c1271"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "62f51ae76a0923114b3f598e9241e4c7"
server_key_iv: "43cee37b56a6474880349b1076c2fa07"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.619975 7538 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 18:38:41.622152 7564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.623306 7538 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:41.623415 7538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "9d108561b5c7426abda45699d81c1271"
format_stamp: "Formatted at 2026-08-08 18:38:41 on dist-test-slave-fgb3"
server_key: "62f51ae76a0923114b3f598e9241e4c7"
server_key_iv: "43cee37b56a6474880349b1076c2fa07"
server_key_version: "encryptionkey@0"
I20260808 18:38:41.623507 7538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:41.640460 7538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:41.643136 7538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:41.643306 7538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:41.644759 7538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:41.644810 7538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:41.644851 7538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:41.644881 7538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:41.655865 7538 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:36999
I20260808 18:38:41.656267 7754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:36999 every 8 connection(s)
I20260808 18:38:41.656867 7538 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:41.658887 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.645525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:44921 (local address 127.4.61.254:43807)
0808 18:38:41.645690 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.645695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.646622 (+ 927us) server_negotiation.cc:407] Connection header received
0808 18:38:41.647910 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.647914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.647979 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.648071 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.649786 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.650428 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.652158 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.652442 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.652538 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.655366 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.655370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.655373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.655400 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.656847 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.657364 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.657368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.657370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.657470 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.657839 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.657844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.657846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.658073 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.658159 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.658645 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.658751 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 18:38:41.659673 7575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.645924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.195:44921)
0808 18:38:41.646448 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.646509 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.647610 (+ 1101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.648301 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.648313 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.648885 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.649597 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.649621 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.650544 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.650548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.652023 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.652035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.652604 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.652609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.652827 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.653460 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.653482 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.655199 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.656964 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.656971 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.656986 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.657240 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.657573 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.657576 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.657578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.657739 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.658158 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.658163 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.658431 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.658585 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.658836 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":110,"threads_started":1}
I20260808 18:38:41.660916 7755 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43807
I20260808 18:38:41.661060 7755 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:41.661540 7755 heartbeater.cc:511] Master 127.4.61.254:43807 requested a full tablet report, sending...
I20260808 18:38:41.662565 6985 ts_manager.cc:194] Registered new tserver with Master: 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999)
I20260808 18:38:41.663264 6985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:44921
I20260808 18:38:41.663743 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7538
I20260808 18:38:41.663867 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:41.664191 4343 external_mini_cluster.cc:1428] Setting key 48df30cd4023093b611573a4b86bceed
I20260808 18:38:41.666111 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:38:41.670030 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.663013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:43323 (local address 127.4.61.254:43807)
0808 18:38:41.663117 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.663122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.663347 (+ 225us) server_negotiation.cc:407] Connection header received
0808 18:38:41.663456 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.663474 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.663521 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.663591 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.664078 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.664615 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.665663 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.665980 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.666076 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.667155 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.667158 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.667161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.667185 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.668645 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.669066 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.669069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.669070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.669134 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.669361 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.669363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.669364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.669513 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.669581 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.669828 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.669914 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 18:38:41.670084 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.662899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.4.61.195:43323)
0808 18:38:41.663261 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.663275 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.663376 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.663634 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.663637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.663843 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.663968 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.663977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.664727 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.664730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.665551 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.665561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.666092 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.666096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.666191 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.666723 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.666737 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.667026 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.668748 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.668752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.668754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.668986 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.669202 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.669204 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.669206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.669293 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.669586 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.669588 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.669685 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.669784 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.669922 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":86,"threads_started":1}
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:41.692390 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.684806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.4.61.254:43807)
0808 18:38:41.684932 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.684935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.684946 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:38:41.684981 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.684983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.685018 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.685083 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.685757 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.686383 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.687190 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.687422 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.687509 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.689658 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.689662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.689665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.689689 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.690947 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.691317 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.691321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.691322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.691397 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.691633 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.691637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.691638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.691801 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.691924 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.692137 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.692242 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:38:41.695072 6985 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:41.697980 6985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:41.711676 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.706702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:32977 (local address 127.0.0.1:39118)
0808 18:38:41.706914 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.706926 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.707008 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.707845 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.707848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.707866 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.707969 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.707976 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.708997 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.709000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.710175 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.710185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.711141 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.711145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.711262 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.711305 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.711417 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.711535 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260808 18:38:41.711722 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.707134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39118 (local address 127.4.61.194:32977)
0808 18:38:41.707403 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.707428 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.707446 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:38:41.707506 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.707510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.707661 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.707803 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.708091 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.708857 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.710295 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.711028 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.711136 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.711300 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.711481 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.711575 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
I20260808 18:38:41.712066 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.705787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.0.0.1:53876)
0808 18:38:41.706551 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.706608 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.707160 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.707694 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.707701 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.707725 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.707855 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.707862 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.709350 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.709354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.710744 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.710751 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.711717 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.711720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.711806 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.711830 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.711880 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.711948 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":67,"thread_start_us":56,"threads_started":1}
I20260808 18:38:41.712623 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.705939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53876 (local address 127.4.61.195:36999)
0808 18:38:41.706702 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.706717 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.706745 (+ 28us) server_negotiation.cc:407] Connection header received
0808 18:38:41.707322 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.707329 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.707533 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.707689 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.707965 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.709185 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.710862 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.711587 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.712232 (+ 645us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.712391 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.712431 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.712495 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":105,"threads_started":1}
I20260808 18:38:41.712998 7793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.705956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46297 (local address 127.0.0.1:53102)
0808 18:38:41.706655 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.706666 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.706776 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.707951 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.707954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.707972 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.708059 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.708065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.709367 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.709369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.710703 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.710715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.712618 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.712622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.712723 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.712747 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.712816 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.712880 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":69,"thread_start_us":93,"threads_started":1}
I20260808 18:38:41.713428 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.706122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53102 (local address 127.4.61.193:46297)
0808 18:38:41.707239 (+ 1117us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.707255 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.707278 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:38:41.707339 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.707343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.707534 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.707689 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.708158 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.709257 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.710823 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.711576 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.711670 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.712250 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.713198 (+ 948us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.713295 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1016,"thread_start_us":81,"threads_started":1}
I20260808 18:38:41.714776 7420 tablet_service.cc:1467] Processing CreateTablet for tablet d7cd293b970144618df2ce31476bab3a (DEFAULT_TABLE table=test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:41.715161 7647 tablet_service.cc:1467] Processing CreateTablet for tablet d7cd293b970144618df2ce31476bab3a (DEFAULT_TABLE table=test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:41.715727 7420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cd293b970144618df2ce31476bab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.716182 7647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cd293b970144618df2ce31476bab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.715931 7196 tablet_service.cc:1467] Processing CreateTablet for tablet d7cd293b970144618df2ce31476bab3a (DEFAULT_TABLE table=test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:41.716938 7196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cd293b970144618df2ce31476bab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.722878 7797 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Bootstrap starting.
I20260808 18:38:41.723955 7798 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Bootstrap starting.
I20260808 18:38:41.724834 7799 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Bootstrap starting.
I20260808 18:38:41.725452 7797 tablet_bootstrap.cc:654] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.726032 7798 tablet_bootstrap.cc:654] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.726374 7797 log.cc:824] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:41.726684 7799 tablet_bootstrap.cc:654] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.726912 7798 log.cc:824] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:41.727440 7799 log.cc:824] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:41.728658 7797 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: No bootstrap required, opened a new log
I20260808 18:38:41.728854 7798 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: No bootstrap required, opened a new log
I20260808 18:38:41.728885 7797 ts_tablet_manager.cc:1397] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:38:41.729036 7798 ts_tablet_manager.cc:1397] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:38:41.729964 7799 tablet_bootstrap.cc:492] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: No bootstrap required, opened a new log
I20260808 18:38:41.730139 7799 ts_tablet_manager.cc:1397] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:38:41.732008 7798 raft_consensus.cc:348] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.732228 7798 raft_consensus.cc:374] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.732278 7798 raft_consensus.cc:729] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.732685 7798 consensus_queue.cc:260] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.732769 7797 raft_consensus.cc:348] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.733040 7797 raft_consensus.cc:374] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.733100 7797 raft_consensus.cc:729] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.733455 7755 heartbeater.cc:503] Master 127.4.61.254:43807 was elected leader, sending a full tablet report...
I20260808 18:38:41.733520 7797 consensus_queue.cc:260] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.733754 7798 ts_tablet_manager.cc:1428] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:38:41.734292 7526 heartbeater.cc:503] Master 127.4.61.254:43807 was elected leader, sending a full tablet report...
I20260808 18:38:41.734141 7799 raft_consensus.cc:348] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.734421 7799 raft_consensus.cc:374] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.734483 7799 raft_consensus.cc:729] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.734522 7797 ts_tablet_manager.cc:1428] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:38:41.734892 7799 consensus_queue.cc:260] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.735766 7799 ts_tablet_manager.cc:1428] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:38:41.736055 7298 heartbeater.cc:503] Master 127.4.61.254:43807 was elected leader, sending a full tablet report...
I20260808 18:38:41.782971 7806 raft_consensus.cc:482] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:41.783218 7806 raft_consensus.cc:504] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.784446 7806 leader_election.cc:288] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999), 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297)
I20260808 18:38:41.788636 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.784686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.4.61.194:46575)
0808 18:38:41.784819 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.784834 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.784940 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.785197 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.785200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.785215 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.785335 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.785340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.786372 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.786376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.787645 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.787659 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.788292 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.788296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.788387 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.788413 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.788469 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.788529 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 18:38:41.788698 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.784840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:46575 (local address 127.4.61.195:36999)
0808 18:38:41.784981 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.784986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.785000 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:38:41.785055 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.785057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.785100 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.785165 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.785437 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.786247 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.787772 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.788178 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.788286 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.788349 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.788501 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.788574 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 18:38:41.789366 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.784706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46297 (local address 127.4.61.194:48349)
0808 18:38:41.785103 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.785113 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.785198 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.785428 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.785430 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.785448 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.785537 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.785541 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.786477 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.786480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.788177 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.788187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.788999 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.789003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.789097 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.789119 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.789191 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.789251 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":153,"threads_started":1}
I20260808 18:38:41.789426 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.784880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:48349 (local address 127.4.61.193:46297)
0808 18:38:41.784993 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.784998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.785187 (+ 189us) server_negotiation.cc:407] Connection header received
0808 18:38:41.785293 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.785296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.785339 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.785401 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.785628 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.786386 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.788309 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.788863 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.788978 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.789027 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.789227 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.789309 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:38:41.789680 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cd293b970144618df2ce31476bab3a" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271" is_pre_election: true
I20260808 18:38:41.790017 7684 raft_consensus.cc:2454] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 0.
I20260808 18:38:41.790107 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cd293b970144618df2ce31476bab3a" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2" is_pre_election: true
I20260808 18:38:41.790434 7220 raft_consensus.cc:2454] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 0.
I20260808 18:38:41.790495 7341 leader_election.cc:302] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e74a93e81409087e99543ec40e1ef, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:41.790766 7806 raft_consensus.cc:2781] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:41.790850 7806 raft_consensus.cc:482] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:41.790881 7806 raft_consensus.cc:3037] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.791913 7806 raft_consensus.cc:504] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.792258 7806 leader_election.cc:288] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 election: Requested vote from peers 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999), 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297)
I20260808 18:38:41.792567 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cd293b970144618df2ce31476bab3a" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271"
I20260808 18:38:41.792610 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cd293b970144618df2ce31476bab3a" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2"
I20260808 18:38:41.792711 7220 raft_consensus.cc:3037] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.792701 7684 raft_consensus.cc:3037] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.793984 7684 raft_consensus.cc:2454] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 1.
I20260808 18:38:41.793991 7220 raft_consensus.cc:2454] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 1.
I20260808 18:38:41.794276 7341 leader_election.cc:302] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e74a93e81409087e99543ec40e1ef, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:41.794467 7806 raft_consensus.cc:2781] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:41.794669 7806 raft_consensus.cc:686] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 1 LEADER]: Becoming Leader. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Running, Role: LEADER
I20260808 18:38:41.795006 7806 consensus_queue.cc:237] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } }
I20260808 18:38:41.798233 6983 catalog_manager.cc:5495] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194). New cstate: current_term: 1 leader_uuid: "9b5e74a93e81409087e99543ec40e1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } health_report { overall_health: HEALTHY } } }
Aug 08 18:38:41 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214320, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:41.848798 7820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.840447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43807 (local address 127.0.0.1:42982)
0808 18:38:41.840791 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.840805 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.840996 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.841238 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.841241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.841686 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:41.841802 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.841809 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.842603 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.842607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.843155 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.843162 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.843570 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.843574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.843695 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.844246 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:41.844266 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:41.845720 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:41.847348 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.847358 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.847364 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.847615 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.847910 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:41.847912 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:41.847913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:41.847989 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:41.848300 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:41.848306 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:41.848434 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.848526 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.848649 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":30,"thread_start_us":131,"threads_started":1}
I20260808 18:38:41.848919 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.840512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.4.61.254:43807)
0808 18:38:41.840632 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.840637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.840956 (+ 319us) server_negotiation.cc:407] Connection header received
0808 18:38:41.841086 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.841089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.841130 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.841195 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:41.841922 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.842503 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.843267 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.843474 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.843559 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.845855 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:41.845858 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:41.845860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:41.845882 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:41.847205 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.847730 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.847734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.847735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.847829 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:41.848049 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:41.848051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:41.848052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:41.848222 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:41.848295 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.848631 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.848758 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":40}
I20260808 18:38:41.853611 6983 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:42982:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 18:38:41.854434 6983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:41.859501 7420 tablet_service.cc:1467] Processing CreateTablet for tablet 046417e83f0f4c71a0f3573c1a66dd94 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d31f1cd28d54be0aae704b361c5e364]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:41.859505 7196 tablet_service.cc:1467] Processing CreateTablet for tablet 046417e83f0f4c71a0f3573c1a66dd94 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d31f1cd28d54be0aae704b361c5e364]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:41.860370 7196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046417e83f0f4c71a0f3573c1a66dd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.860347 7647 tablet_service.cc:1467] Processing CreateTablet for tablet 046417e83f0f4c71a0f3573c1a66dd94 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d31f1cd28d54be0aae704b361c5e364]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:38:41.861006 7647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046417e83f0f4c71a0f3573c1a66dd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.861346 7420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046417e83f0f4c71a0f3573c1a66dd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:41.863647 7799 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: Bootstrap starting.
I20260808 18:38:41.863785 7798 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: Bootstrap starting.
I20260808 18:38:41.863945 7797 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: Bootstrap starting.
I20260808 18:38:41.864631 7798 tablet_bootstrap.cc:654] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.864682 7799 tablet_bootstrap.cc:654] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.864846 7797 tablet_bootstrap.cc:654] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:41.866047 7799 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: No bootstrap required, opened a new log
I20260808 18:38:41.866144 7799 ts_tablet_manager.cc:1397] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:41.866207 7797 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: No bootstrap required, opened a new log
I20260808 18:38:41.866289 7797 ts_tablet_manager.cc:1397] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:41.866688 7799 raft_consensus.cc:348] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.866729 7797 raft_consensus.cc:348] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.866830 7797 raft_consensus.cc:374] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.866832 7799 raft_consensus.cc:374] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.866871 7797 raft_consensus.cc:729] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.866881 7799 raft_consensus.cc:729] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.867002 7797 consensus_queue.cc:260] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.867002 7799 consensus_queue.cc:260] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.867261 7799 ts_tablet_manager.cc:1428] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 18:38:41.867252 7806 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.867408 7806 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.867260 7797 ts_tablet_manager.cc:1428] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:38:41.867478 7809 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.867604 7809 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.869036 7798 tablet_bootstrap.cc:492] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: No bootstrap required, opened a new log
I20260808 18:38:41.869127 7798 ts_tablet_manager.cc:1397] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 18:38:41.869560 7798 raft_consensus.cc:348] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.869647 7798 raft_consensus.cc:374] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:41.869666 7798 raft_consensus.cc:729] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Initialized, Role: FOLLOWER
I20260808 18:38:41.869768 7798 consensus_queue.cc:260] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.870020 7805 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.870167 7805 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.870021 7798 ts_tablet_manager.cc:1428] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260808 18:38:41.907929 7756 tablet.cc:2369] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:41.921150 7805 raft_consensus.cc:482] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:41.921298 7805 raft_consensus.cc:504] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.922556 7805 leader_election.cc:288] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977)
W20260808 18:38:41.922993 7527 tablet.cc:2369] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:41.927400 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.922991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:51959 (local address 127.4.61.193:46297)
0808 18:38:41.923123 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.923128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.923527 (+ 399us) server_negotiation.cc:407] Connection header received
0808 18:38:41.923591 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.923594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.923645 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.923735 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.924051 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.924827 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.926356 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.926884 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.926991 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.927048 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.927199 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.927289 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:38:41.927392 7575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.922866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46297 (local address 127.4.61.195:51959)
0808 18:38:41.923319 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.923334 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.923437 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.923761 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.923764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.923783 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.923901 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.923909 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.924975 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.924978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.926201 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.926212 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.926990 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.926994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.927088 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.927110 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.927175 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.927245 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375}
I20260808 18:38:41.927955 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.923484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47487 (local address 127.4.61.194:32977)
0808 18:38:41.923637 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.923641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.924247 (+ 606us) server_negotiation.cc:407] Connection header received
0808 18:38:41.924365 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.924368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.924419 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.924481 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:41.924727 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.925303 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.926650 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.927238 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.927344 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.927389 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.927748 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.927829 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 18:38:41.928046 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046417e83f0f4c71a0f3573c1a66dd94" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2" is_pre_election: true
I20260808 18:38:41.928215 7220 raft_consensus.cc:2454] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 0.
I20260808 18:38:41.928363 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.923714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:32977 (local address 127.4.61.195:47487)
0808 18:38:41.924055 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.924066 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.924269 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.924496 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.924499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.924515 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:41.924632 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.924637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.925405 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.925409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.926509 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.926520 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.927478 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.927482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.927584 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.927607 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.928154 (+ 547us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.928230 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":133,"threads_started":1}
I20260808 18:38:41.928565 7567 leader_election.cc:302] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c396c6deba64172babf46b28ad0e4d2, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:41.928834 7805 raft_consensus.cc:2781] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:41.928905 7805 raft_consensus.cc:482] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:41.928953 7805 raft_consensus.cc:3037] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.929333 7447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046417e83f0f4c71a0f3573c1a66dd94" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef" is_pre_election: true
I20260808 18:38:41.929546 7447 raft_consensus.cc:2454] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 0.
I20260808 18:38:41.930166 7805 raft_consensus.cc:504] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.930547 7805 leader_election.cc:288] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 election: Requested vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977)
I20260808 18:38:41.930899 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046417e83f0f4c71a0f3573c1a66dd94" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2"
I20260808 18:38:41.930894 7447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046417e83f0f4c71a0f3573c1a66dd94" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef"
I20260808 18:38:41.930994 7220 raft_consensus.cc:3037] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.930999 7447 raft_consensus.cc:3037] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:41.931895 7220 raft_consensus.cc:2454] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 1.
I20260808 18:38:41.932119 7447 raft_consensus.cc:2454] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 1.
I20260808 18:38:41.932188 7567 leader_election.cc:302] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c396c6deba64172babf46b28ad0e4d2, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:41.932366 7805 raft_consensus.cc:2781] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:41.932582 7805 raft_consensus.cc:686] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [term 1 LEADER]: Becoming Leader. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Running, Role: LEADER
I20260808 18:38:41.932925 7805 consensus_queue.cc:237] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:41.935325 7826 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: TxnStatusTablet state changed. Reason: New leader 9d108561b5c7426abda45699d81c1271. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.935432 7826 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:41.936563 6985 catalog_manager.cc:5495] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d108561b5c7426abda45699d81c1271 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260808 18:38:41.937819 7828 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 18:38:41.938045 7828 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 18:38:41.951377 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.947120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53890 (local address 127.4.61.195:36999)
0808 18:38:41.947554 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.947558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.947570 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:38:41.947627 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.947630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.947678 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.947750 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:41.948060 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.948556 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.949802 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.950047 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.950160 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.950550 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:41.950969 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:41.951071 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.951171 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.951231 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357}
I20260808 18:38:41.951377 7820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.947027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.0.0.1:53890)
0808 18:38:41.947242 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.947255 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.947339 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.947799 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.947802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.947813 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:41.947938 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.947945 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.948655 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.948658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.949645 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.949657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.950183 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.950187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.950297 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.950396 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:41.951070 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:41.951086 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.951153 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.951247 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
W20260808 18:38:41.956686 7302 tablet.cc:2369] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:41.956789 7447 raft_consensus.cc:1261] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Refusing update from remote peer 9d108561b5c7426abda45699d81c1271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:41.956808 7220 raft_consensus.cc:1261] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d108561b5c7426abda45699d81c1271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:41.957449 7805 consensus_queue.cc:1035] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:41.957640 7826 consensus_queue.cc:1035] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:41.960904 7806 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: TxnStatusTablet state changed. Reason: New leader 9d108561b5c7426abda45699d81c1271. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.961026 7806 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.961895 7809 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: TxnStatusTablet state changed. Reason: New leader 9d108561b5c7426abda45699d81c1271. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.962029 7809 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.965881 7806 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.965989 7806 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9b5e74a93e81409087e99543ec40e1ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.966156 7809 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.966260 7809 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 2c396c6deba64172babf46b28ad0e4d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:38:41.966882 7834 mvcc.cc:205] Tried to move back new op lower bound from 7316333862727593984 to 7316333862639906816. Current Snapshot: MvccSnapshot[applied={T|T < 7316333862727593984}]
I20260808 18:38:41.966948 7838 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.967061 7838 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:41.967257 7805 tablet_replica.cc:439] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } } }
I20260808 18:38:41.967346 7805 tablet_replica.cc:442] T 046417e83f0f4c71a0f3573c1a66dd94 P 9d108561b5c7426abda45699d81c1271: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:38:41.967669 7835 mvcc.cc:205] Tried to move back new op lower bound from 7316333862727593984 to 7316333862639906816. Current Snapshot: MvccSnapshot[applied={T|T < 7316333862727593984}]
I20260808 18:38:41.976663 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.972917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.4.61.194:32977)
0808 18:38:41.973041 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.973046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.973060 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:38:41.973202 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.973204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.973253 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.973367 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:41.973601 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.974093 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.975291 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.975518 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.975616 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.975887 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:41.976295 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:41.976392 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.976470 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.976521 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 18:38:41.989616 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.984692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:59341 (local address 127.4.61.195:36999)
0808 18:38:41.984797 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:41.984802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:41.985221 (+ 419us) server_negotiation.cc:407] Connection header received
0808 18:38:41.985472 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:41.985476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:41.985539 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:41.985595 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:41.986029 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.986866 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.988147 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.988487 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.988574 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.989073 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:41.989163 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:41.989228 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:41.989413 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 18:38:41.989470 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:38:41.990023 7849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:41.984318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.4.61.194:59341)
0808 18:38:41.984856 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:41.984873 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:41.985325 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:41.985754 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:41.985758 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:41.985767 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:41.985885 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.985892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.987029 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.987032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.987989 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:41.988003 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:41.988717 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:41.988722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:41.988816 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:41.988875 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:41.989304 (+ 429us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:41.989311 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:38:41.989768 (+ 457us) client_negotiation.cc:240] Negotiation successful
0808 18:38:41.989858 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":107,"threads_started":1}
I20260808 18:38:41.997669 7220 raft_consensus.cc:1261] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e74a93e81409087e99543ec40e1ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:41.997855 7684 raft_consensus.cc:1261] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e74a93e81409087e99543ec40e1ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:41.998171 7806 consensus_queue.cc:1035] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:41.998349 7811 consensus_queue.cc:1035] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:42.004980 7833 mvcc.cc:205] Tried to move back new op lower bound from 7316333862898438144 to 7316333862074933248. Current Snapshot: MvccSnapshot[applied={T|T < 7316333862898438144}]
I20260808 18:38:42.022053 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:42.018473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:32977 (local address 127.4.61.195:33931)
0808 18:38:42.018647 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:42.018663 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:42.018742 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:42.018949 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:42.018951 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:42.018956 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:42.019085 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:42.019092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:42.020062 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:42.020065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:42.020879 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:42.020888 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:42.021452 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:42.021455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:42.021528 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:42.021577 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:42.021833 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:42.021837 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 18:38:42.021878 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 18:38:42.021951 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 18:38:42.022074 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:42.018527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:33931 (local address 127.4.61.194:32977)
0808 18:38:42.018638 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:42.018642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:42.018704 (+ 62us) server_negotiation.cc:407] Connection header received
0808 18:38:42.018812 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:42.018815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:42.018864 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:42.018940 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:42.019181 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:42.019962 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:42.020994 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:42.021333 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:42.021436 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:42.021686 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:42.021768 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:42.021833 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:42.021891 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 18:38:42.021942 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:38:42.048625 6983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:42.048832 6983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:42.051586 6983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Sending DeleteTablet for 3 replicas of tablet d7cd293b970144618df2ce31476bab3a
I20260808 18:38:42.052615 7196 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cd293b970144618df2ce31476bab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:42 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53102
I20260808 18:38:42.053195 7860 tablet_replica.cc:330] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: stopping tablet replica
I20260808 18:38:42.053154 7420 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cd293b970144618df2ce31476bab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:42 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:39118
I20260808 18:38:42.053640 7860 raft_consensus.cc:2229] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:42.053735 7647 tablet_service.cc:1514] Processing DeleteTablet for tablet d7cd293b970144618df2ce31476bab3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:42 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53876
I20260808 18:38:42.053998 7860 raft_consensus.cc:2258] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:42.055011 6983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:42.055469 6983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:42.055874 7860 ts_tablet_manager.cc:1905] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:42.058497 7864 tablet_replica.cc:330] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: stopping tablet replica
I20260808 18:38:42.058804 7864 raft_consensus.cc:2229] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:42.059190 7860 ts_tablet_manager.cc:1918] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:42.059197 7864 raft_consensus.cc:2258] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:42.059340 7860 log.cc:1196] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/d7cd293b970144618df2ce31476bab3a
I20260808 18:38:42.059707 7860 ts_tablet_manager.cc:1939] T d7cd293b970144618df2ce31476bab3a P 2c396c6deba64172babf46b28ad0e4d2: Deleting consensus metadata
I20260808 18:38:42.060763 7420 tablet_service.cc:1467] Processing CreateTablet for tablet ce940e42b78347abae601afc389b9eb0 (DEFAULT_TABLE table=test-table [id=43f1ed981318439b91bec05e75edbc90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:42.061029 7420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce940e42b78347abae601afc389b9eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:42.061074 6964 catalog_manager.cc:4841] TS 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297): tablet d7cd293b970144618df2ce31476bab3a (table test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]) successfully deleted
I20260808 18:38:42.062592 7196 tablet_service.cc:1467] Processing CreateTablet for tablet ce940e42b78347abae601afc389b9eb0 (DEFAULT_TABLE table=test-table [id=43f1ed981318439b91bec05e75edbc90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:42.062821 7196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce940e42b78347abae601afc389b9eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:42.063467 7797 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Bootstrap starting.
I20260808 18:38:42.064400 7797 tablet_bootstrap.cc:654] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:42.064906 7799 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Bootstrap starting.
I20260808 18:38:42.065768 7799 tablet_bootstrap.cc:654] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:42.065901 7797 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: No bootstrap required, opened a new log
I20260808 18:38:42.065975 7797 ts_tablet_manager.cc:1397] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:42.066466 7797 raft_consensus.cc:348] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.066589 7797 raft_consensus.cc:374] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:42.066629 7797 raft_consensus.cc:729] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Initialized, Role: FOLLOWER
I20260808 18:38:42.066749 7797 consensus_queue.cc:260] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.067003 7797 ts_tablet_manager.cc:1428] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:42.067476 7864 ts_tablet_manager.cc:1905] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:42.067431 7647 tablet_service.cc:1467] Processing CreateTablet for tablet ce940e42b78347abae601afc389b9eb0 (DEFAULT_TABLE table=test-table [id=43f1ed981318439b91bec05e75edbc90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:42.067698 7647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce940e42b78347abae601afc389b9eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:42.068032 7799 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: No bootstrap required, opened a new log
I20260808 18:38:42.068110 7799 ts_tablet_manager.cc:1397] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 18:38:42.068506 7799 raft_consensus.cc:348] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.068608 7799 raft_consensus.cc:374] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:42.068641 7799 raft_consensus.cc:729] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Initialized, Role: FOLLOWER
I20260808 18:38:42.068750 7799 consensus_queue.cc:260] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.069005 7799 ts_tablet_manager.cc:1428] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:42.069474 7865 tablet_replica.cc:330] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: stopping tablet replica
I20260808 18:38:42.069794 7865 raft_consensus.cc:2229] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:42.070022 7865 raft_consensus.cc:2258] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:42.070091 7798 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Bootstrap starting.
I20260808 18:38:42.070144 7864 ts_tablet_manager.cc:1918] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:42.070242 7864 log.cc:1196] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/d7cd293b970144618df2ce31476bab3a
I20260808 18:38:42.070564 7864 ts_tablet_manager.cc:1939] T d7cd293b970144618df2ce31476bab3a P 9b5e74a93e81409087e99543ec40e1ef: Deleting consensus metadata
I20260808 18:38:42.070951 7798 tablet_bootstrap.cc:654] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:42.071592 6964 catalog_manager.cc:4841] TS 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977): tablet d7cd293b970144618df2ce31476bab3a (table test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]) successfully deleted
I20260808 18:38:42.072203 7798 tablet_bootstrap.cc:492] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: No bootstrap required, opened a new log
I20260808 18:38:42.072279 7798 ts_tablet_manager.cc:1397] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:42.072959 7798 raft_consensus.cc:348] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.073050 7798 raft_consensus.cc:374] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:42.073078 7798 raft_consensus.cc:729] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Initialized, Role: FOLLOWER
I20260808 18:38:42.073190 7798 consensus_queue.cc:260] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.073441 7798 ts_tablet_manager.cc:1428] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:42.075176 7865 ts_tablet_manager.cc:1905] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:42.077672 7865 ts_tablet_manager.cc:1918] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:42.077754 7865 log.cc:1196] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/d7cd293b970144618df2ce31476bab3a
I20260808 18:38:42.078030 7865 ts_tablet_manager.cc:1939] T d7cd293b970144618df2ce31476bab3a P 9d108561b5c7426abda45699d81c1271: Deleting consensus metadata
I20260808 18:38:42.079285 6965 catalog_manager.cc:4841] TS 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999): tablet d7cd293b970144618df2ce31476bab3a (table test-table [id=84e4c0fa16aa4a42991bcb74a5a94169]) successfully deleted
I20260808 18:38:42.137228 7856 raft_consensus.cc:482] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:42.137364 7856 raft_consensus.cc:504] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.137758 7856 leader_election.cc:288] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999)
I20260808 18:38:42.138227 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce940e42b78347abae601afc389b9eb0" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271" is_pre_election: true
I20260808 18:38:42.138227 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce940e42b78347abae601afc389b9eb0" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2" is_pre_election: true
I20260808 18:38:42.138410 7684 raft_consensus.cc:2454] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 0.
I20260808 18:38:42.138438 7220 raft_consensus.cc:2454] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 0.
I20260808 18:38:42.138707 7341 leader_election.cc:302] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e74a93e81409087e99543ec40e1ef, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:42.138908 7856 raft_consensus.cc:2781] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:42.138967 7856 raft_consensus.cc:482] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:42.139003 7856 raft_consensus.cc:3037] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:42.140333 7856 raft_consensus.cc:504] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.140656 7856 leader_election.cc:288] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 election: Requested vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999)
I20260808 18:38:42.141006 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce940e42b78347abae601afc389b9eb0" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271"
I20260808 18:38:42.141014 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce940e42b78347abae601afc389b9eb0" candidate_uuid: "9b5e74a93e81409087e99543ec40e1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2"
I20260808 18:38:42.141124 7684 raft_consensus.cc:3037] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:42.141132 7220 raft_consensus.cc:3037] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:42.142004 7684 raft_consensus.cc:2454] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 1.
I20260808 18:38:42.142263 7341 leader_election.cc:302] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e74a93e81409087e99543ec40e1ef, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:42.142277 7220 raft_consensus.cc:2454] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e74a93e81409087e99543ec40e1ef in term 1.
I20260808 18:38:42.142452 7856 raft_consensus.cc:2781] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:42.142532 7856 raft_consensus.cc:686] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 LEADER]: Becoming Leader. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Running, Role: LEADER
I20260808 18:38:42.142668 7856 consensus_queue.cc:237] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:42.144454 6983 catalog_manager.cc:5495] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194). New cstate: current_term: 1 leader_uuid: "9b5e74a93e81409087e99543ec40e1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:42.164783 7219 raft_consensus.cc:1261] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e74a93e81409087e99543ec40e1ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:42.164992 7684 raft_consensus.cc:1261] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e74a93e81409087e99543ec40e1ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:42.165239 7856 consensus_queue.cc:1035] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:42.165397 7811 consensus_queue.cc:1035] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 18:38:42.181428 7834 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 18:38:43.733296 6986 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:43.733449 6986 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:43.735621 6986 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Sending DeleteTablet for 3 replicas of tablet ce940e42b78347abae601afc389b9eb0
I20260808 18:38:43.736101 7196 tablet_service.cc:1514] Processing DeleteTablet for tablet ce940e42b78347abae601afc389b9eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53102
I20260808 18:38:43.736169 7420 tablet_service.cc:1514] Processing DeleteTablet for tablet ce940e42b78347abae601afc389b9eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:39118
I20260808 18:38:43.736212 7647 tablet_service.cc:1514] Processing DeleteTablet for tablet ce940e42b78347abae601afc389b9eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53876
I20260808 18:38:43.736425 7917 tablet_replica.cc:330] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: stopping tablet replica
I20260808 18:38:43.736547 7917 raft_consensus.cc:2229] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:43.736563 7918 tablet_replica.cc:330] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: stopping tablet replica
I20260808 18:38:43.736649 7917 raft_consensus.cc:2258] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.736665 7918 raft_consensus.cc:2229] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:43.736831 7919 tablet_replica.cc:330] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: stopping tablet replica
I20260808 18:38:43.736829 7918 raft_consensus.cc:2258] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.736986 7919 raft_consensus.cc:2229] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:43.737126 7919 raft_consensus.cc:2258] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.737273 7917 ts_tablet_manager.cc:1905] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:43.737357 7918 ts_tablet_manager.cc:1905] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:43.737782 7919 ts_tablet_manager.cc:1905] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:43.739897 7917 ts_tablet_manager.cc:1918] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 18:38:43.739943 7918 ts_tablet_manager.cc:1918] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 18:38:43.739980 7917 log.cc:1196] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/ce940e42b78347abae601afc389b9eb0
I20260808 18:38:43.740000 7918 log.cc:1196] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/ce940e42b78347abae601afc389b9eb0
I20260808 18:38:43.740237 7917 ts_tablet_manager.cc:1939] T ce940e42b78347abae601afc389b9eb0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting consensus metadata
I20260808 18:38:43.740285 7918 ts_tablet_manager.cc:1939] T ce940e42b78347abae601afc389b9eb0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting consensus metadata
I20260808 18:38:43.740392 7919 ts_tablet_manager.cc:1918] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 18:38:43.740470 7919 log.cc:1196] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/ce940e42b78347abae601afc389b9eb0
I20260808 18:38:43.740684 7919 ts_tablet_manager.cc:1939] T ce940e42b78347abae601afc389b9eb0 P 9d108561b5c7426abda45699d81c1271: Deleting consensus metadata
I20260808 18:38:43.740857 6964 catalog_manager.cc:4841] TS 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297): tablet ce940e42b78347abae601afc389b9eb0 (table test-table [id=43f1ed981318439b91bec05e75edbc90]) successfully deleted
I20260808 18:38:43.740996 6964 catalog_manager.cc:4841] TS 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977): tablet ce940e42b78347abae601afc389b9eb0 (table test-table [id=43f1ed981318439b91bec05e75edbc90]) successfully deleted
I20260808 18:38:43.741252 6965 catalog_manager.cc:4841] TS 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999): tablet ce940e42b78347abae601afc389b9eb0 (table test-table [id=43f1ed981318439b91bec05e75edbc90]) successfully deleted
Aug 08 18:38:43 dist-test-slave-fgb3 krb5kdc[6920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 18:38:43 dist-test-slave-fgb3 krb5kdc[6920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:43.764251 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:43.756343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39424 (local address 127.4.61.254:43807)
0808 18:38:43.756608 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:43.756616 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:43.756683 (+ 67us) server_negotiation.cc:407] Connection header received
0808 18:38:43.756836 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:43.756839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:43.756885 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:43.756960 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:43.757618 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.758194 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.759055 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.759282 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.759369 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:43.761524 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:43.761527 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:43.761529 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:43.761553 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:43.762989 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:43.763333 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:43.763335 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:43.763337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:43.763419 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:43.763598 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:43.763600 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:43.763601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:43.763765 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:43.763858 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:43.764024 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 18:38:43.764121 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":106,"threads_started":1}
I20260808 18:38:43.766571 6986 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:43.767019 6986 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:43.771660 7420 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcee680dc44863b213563af22d0da0 (DEFAULT_TABLE table=test-table [id=5797eca20ba943c5ba25a1f1498fb223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.771649 7196 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcee680dc44863b213563af22d0da0 (DEFAULT_TABLE table=test-table [id=5797eca20ba943c5ba25a1f1498fb223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.771772 7647 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcee680dc44863b213563af22d0da0 (DEFAULT_TABLE table=test-table [id=5797eca20ba943c5ba25a1f1498fb223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.771973 7196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcee680dc44863b213563af22d0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.771979 7420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcee680dc44863b213563af22d0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.772033 7647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcee680dc44863b213563af22d0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.774365 7935 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Bootstrap starting.
I20260808 18:38:43.774766 7939 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Bootstrap starting.
I20260808 18:38:43.775185 7935 tablet_bootstrap.cc:654] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.775638 7939 tablet_bootstrap.cc:654] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.776234 7935 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: No bootstrap required, opened a new log
I20260808 18:38:43.776317 7935 ts_tablet_manager.cc:1397] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:43.776574 7937 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Bootstrap starting.
I20260808 18:38:43.776718 7935 raft_consensus.cc:348] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.776826 7935 raft_consensus.cc:374] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.776858 7935 raft_consensus.cc:729] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.776990 7935 consensus_queue.cc:260] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.777318 7939 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: No bootstrap required, opened a new log
I20260808 18:38:43.777331 7935 ts_tablet_manager.cc:1428] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:43.777410 7939 ts_tablet_manager.cc:1397] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:43.777609 7937 tablet_bootstrap.cc:654] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.777922 7939 raft_consensus.cc:348] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.778066 7939 raft_consensus.cc:374] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.778105 7939 raft_consensus.cc:729] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.778347 7939 consensus_queue.cc:260] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.778792 7939 ts_tablet_manager.cc:1428] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:43.778964 7937 tablet_bootstrap.cc:492] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: No bootstrap required, opened a new log
I20260808 18:38:43.779042 7937 ts_tablet_manager.cc:1397] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:43.779412 7937 raft_consensus.cc:348] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.779538 7937 raft_consensus.cc:374] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.779573 7937 raft_consensus.cc:729] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.779699 7937 consensus_queue.cc:260] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.779955 7937 ts_tablet_manager.cc:1428] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:38:43.863889 7906 raft_consensus.cc:482] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:43.864033 7906 raft_consensus.cc:504] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.864465 7906 leader_election.cc:288] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977)
I20260808 18:38:43.864919 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcee680dc44863b213563af22d0da0" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2" is_pre_election: true
I20260808 18:38:43.864974 7447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcee680dc44863b213563af22d0da0" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef" is_pre_election: true
I20260808 18:38:43.865072 7220 raft_consensus.cc:2454] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 0.
I20260808 18:38:43.865141 7447 raft_consensus.cc:2454] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 0.
I20260808 18:38:43.865386 7567 leader_election.cc:302] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c396c6deba64172babf46b28ad0e4d2, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:43.865551 7906 raft_consensus.cc:2781] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:43.865612 7906 raft_consensus.cc:482] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:43.865656 7906 raft_consensus.cc:3037] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:43.866762 7906 raft_consensus.cc:504] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.867106 7906 leader_election.cc:288] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 election: Requested vote from peers 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297), 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977)
I20260808 18:38:43.867477 7447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcee680dc44863b213563af22d0da0" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef"
I20260808 18:38:43.867517 7220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcee680dc44863b213563af22d0da0" candidate_uuid: "9d108561b5c7426abda45699d81c1271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c396c6deba64172babf46b28ad0e4d2"
I20260808 18:38:43.867591 7447 raft_consensus.cc:3037] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:43.867622 7220 raft_consensus.cc:3037] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:43.868480 7447 raft_consensus.cc:2454] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 1.
I20260808 18:38:43.868515 7220 raft_consensus.cc:2454] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d108561b5c7426abda45699d81c1271 in term 1.
I20260808 18:38:43.868745 7567 leader_election.cc:302] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e74a93e81409087e99543ec40e1ef, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:43.868917 7906 raft_consensus.cc:2781] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:43.869012 7906 raft_consensus.cc:686] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 1 LEADER]: Becoming Leader. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Running, Role: LEADER
I20260808 18:38:43.869155 7906 consensus_queue.cc:237] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.870790 6986 catalog_manager.cc:5495] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d108561b5c7426abda45699d81c1271 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "9d108561b5c7426abda45699d81c1271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260808 18:38:43.904651 7948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:43.901687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39960 (local address 127.4.61.195:36999)
0808 18:38:43.901935 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:43.901942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:43.901953 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:38:43.901990 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:43.901992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:43.902032 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:43.902106 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:43.902301 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.902887 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.903730 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.903981 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.904055 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:43.904275 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:43.904344 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:43.904393 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:43.904461 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 18:38:43.904509 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":99,"threads_started":1}
I20260808 18:38:43.912822 7948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:43.910108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:48321 (local address 127.4.61.195:36999)
0808 18:38:43.910215 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:43.910219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:43.910418 (+ 199us) server_negotiation.cc:407] Connection header received
0808 18:38:43.910528 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:43.910530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:43.910568 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:43.910624 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:43.910783 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.911287 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.912068 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.912262 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.912325 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:43.912499 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:43.912556 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:43.912601 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:43.912664 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 18:38:43.912704 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 18:38:43.912844 7952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:43.910061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.4.61.195:48321)
0808 18:38:43.910341 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:43.910355 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:43.910448 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:43.910630 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:43.910632 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:43.910637 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:43.910718 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:43.910722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.911385 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.911389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:43.911983 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:43.911991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:43.912335 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:43.912337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:43.912401 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:43.912423 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:43.912612 (+ 189us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:43.912615 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 18:38:43.912656 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 18:38:43.912713 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260808 18:38:43.918007 7447 raft_consensus.cc:1261] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Refusing update from remote peer 9d108561b5c7426abda45699d81c1271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:43.918023 7220 raft_consensus.cc:1261] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d108561b5c7426abda45699d81c1271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:43.918390 7884 consensus_queue.cc:1035] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:43.918538 7906 consensus_queue.cc:1035] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:43.952378 6983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:43.952570 6983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:43.954789 6983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Sending DeleteTablet for 3 replicas of tablet 01dcee680dc44863b213563af22d0da0
I20260808 18:38:43.955449 7420 tablet_service.cc:1514] Processing DeleteTablet for tablet 01dcee680dc44863b213563af22d0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:39118
I20260808 18:38:43.955530 7645 tablet_service.cc:1514] Processing DeleteTablet for tablet 01dcee680dc44863b213563af22d0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53876
I20260808 18:38:43.955651 7918 tablet_replica.cc:330] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: stopping tablet replica
I20260808 18:38:43.955714 7919 tablet_replica.cc:330] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: stopping tablet replica
I20260808 18:38:43.955765 7918 raft_consensus.cc:2229] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:43.955835 7919 raft_consensus.cc:2229] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:43.955881 7918 raft_consensus.cc:2258] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.956156 7919 raft_consensus.cc:2258] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.956288 7196 tablet_service.cc:1514] Processing DeleteTablet for tablet 01dcee680dc44863b213563af22d0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:43 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53102
I20260808 18:38:43.956478 7917 tablet_replica.cc:330] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: stopping tablet replica
I20260808 18:38:43.956601 7917 raft_consensus.cc:2229] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:43.956707 7917 raft_consensus.cc:2258] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:43.956880 6983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 18:38:43.957262 7918 ts_tablet_manager.cc:1905] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 18:38:43.957319 6983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:43.957543 7919 ts_tablet_manager.cc:1905] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:43.960355 7918 ts_tablet_manager.cc:1918] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:43.960445 7918 log.cc:1196] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/01dcee680dc44863b213563af22d0da0
I20260808 18:38:43.960705 7919 ts_tablet_manager.cc:1918] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:43.960731 7918 ts_tablet_manager.cc:1939] T 01dcee680dc44863b213563af22d0da0 P 9b5e74a93e81409087e99543ec40e1ef: Deleting consensus metadata
I20260808 18:38:43.960871 7919 log.cc:1196] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/01dcee680dc44863b213563af22d0da0
I20260808 18:38:43.961186 7919 ts_tablet_manager.cc:1939] T 01dcee680dc44863b213563af22d0da0 P 9d108561b5c7426abda45699d81c1271: Deleting consensus metadata
I20260808 18:38:43.961441 6964 catalog_manager.cc:4841] TS 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977): tablet 01dcee680dc44863b213563af22d0da0 (table test-table [id=5797eca20ba943c5ba25a1f1498fb223]) successfully deleted
I20260808 18:38:43.962004 6965 catalog_manager.cc:4841] TS 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999): tablet 01dcee680dc44863b213563af22d0da0 (table test-table [id=5797eca20ba943c5ba25a1f1498fb223]) successfully deleted
I20260808 18:38:43.962812 7917 ts_tablet_manager.cc:1905] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:43.962790 7420 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 (DEFAULT_TABLE table=test-table [id=397b6b195dff4bb79919ad409e34cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.963048 7420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.965205 7917 ts_tablet_manager.cc:1918] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:38:43.965310 7935 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Bootstrap starting.
I20260808 18:38:43.965329 7917 log.cc:1196] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/01dcee680dc44863b213563af22d0da0
I20260808 18:38:43.965480 7196 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 (DEFAULT_TABLE table=test-table [id=397b6b195dff4bb79919ad409e34cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.965562 7917 ts_tablet_manager.cc:1939] T 01dcee680dc44863b213563af22d0da0 P 2c396c6deba64172babf46b28ad0e4d2: Deleting consensus metadata
I20260808 18:38:43.965711 7196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.966223 7935 tablet_bootstrap.cc:654] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.966179 6964 catalog_manager.cc:4841] TS 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297): tablet 01dcee680dc44863b213563af22d0da0 (table test-table [id=5797eca20ba943c5ba25a1f1498fb223]) successfully deleted
I20260808 18:38:43.966590 7645 tablet_service.cc:1467] Processing CreateTablet for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 (DEFAULT_TABLE table=test-table [id=397b6b195dff4bb79919ad409e34cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:43.966868 7645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:43.967836 7939 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2: Bootstrap starting.
I20260808 18:38:43.968858 7939 tablet_bootstrap.cc:654] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.969239 7937 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Bootstrap starting.
I20260808 18:38:43.970032 7937 tablet_bootstrap.cc:654] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:43.971176 7937 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: No bootstrap required, opened a new log
I20260808 18:38:43.971318 7937 ts_tablet_manager.cc:1397] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:43.971735 7937 raft_consensus.cc:348] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.971858 7937 raft_consensus.cc:374] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.971909 7937 raft_consensus.cc:729] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d108561b5c7426abda45699d81c1271, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.972043 7937 consensus_queue.cc:260] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.972311 7937 ts_tablet_manager.cc:1428] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:43.973480 7935 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: No bootstrap required, opened a new log
I20260808 18:38:43.973595 7935 ts_tablet_manager.cc:1397] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 18:38:43.973742 7939 tablet_bootstrap.cc:492] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2: No bootstrap required, opened a new log
I20260808 18:38:43.973834 7939 ts_tablet_manager.cc:1397] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 18:38:43.974033 7935 raft_consensus.cc:348] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.974160 7935 raft_consensus.cc:374] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.974200 7935 raft_consensus.cc:729] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e74a93e81409087e99543ec40e1ef, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.974278 7939 raft_consensus.cc:348] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.974408 7939 raft_consensus.cc:374] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:43.974365 7935 consensus_queue.cc:260] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.974448 7939 raft_consensus.cc:729] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Initialized, Role: FOLLOWER
I20260808 18:38:43.974560 7939 consensus_queue.cc:260] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:43.974637 7935 ts_tablet_manager.cc:1428] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:43.974812 7939 ts_tablet_manager.cc:1428] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:38:44.033349 7943 raft_consensus.cc:482] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:44.033524 7943 raft_consensus.cc:504] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:44.034857 7943 leader_election.cc:288] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977), 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999)
I20260808 18:38:44.039685 7948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.035136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:53043 (local address 127.4.61.195:36999)
0808 18:38:44.035574 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:44.035579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:44.035675 (+ 96us) server_negotiation.cc:407] Connection header received
0808 18:38:44.035858 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:44.035861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:44.035905 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:44.035966 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:44.036317 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.037081 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.038608 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.039199 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.039323 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.039378 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:44.039513 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 18:38:44.039589 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353}
I20260808 18:38:44.039713 7967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.035051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.4.61.193:53043)
0808 18:38:44.035400 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:44.035414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:44.035734 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:44.035993 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:44.035996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:44.036014 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:44.036150 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.036160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.037207 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.037211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.038485 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.038498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.039307 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.039309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.039389 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.039410 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:38:44.039474 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 18:38:44.039546 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":150,"thread_start_us":93,"threads_started":1}
I20260808 18:38:44.040123 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6bdf5a6fd4a3bb33509a3d296e1d6" candidate_uuid: "2c396c6deba64172babf46b28ad0e4d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271" is_pre_election: true
I20260808 18:38:44.040271 7684 raft_consensus.cc:2454] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c396c6deba64172babf46b28ad0e4d2 in term 0.
I20260808 18:38:44.040766 7119 leader_election.cc:302] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c396c6deba64172babf46b28ad0e4d2, 9d108561b5c7426abda45699d81c1271; no voters:
I20260808 18:38:44.041035 7968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.035051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:32977 (local address 127.4.61.193:40769)
0808 18:38:44.035400 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:44.035429 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:44.035700 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:44.036162 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:44.036165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:44.036183 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:44.036304 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.036311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.037036 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.037040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.038485 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.038498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.040607 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.040610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.040727 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.040749 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:38:44.040821 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 18:38:44.040887 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":26,"thread_start_us":90,"threads_started":1}
I20260808 18:38:44.041061 7943 raft_consensus.cc:2781] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:44.041121 7943 raft_consensus.cc:482] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:44.041164 7943 raft_consensus.cc:3037] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:44.041373 7969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.035265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:40769 (local address 127.4.61.194:32977)
0808 18:38:44.035736 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:44.035751 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:44.035765 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:38:44.035821 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:44.035824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:44.035871 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:44.036131 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:44.036412 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.036927 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.039438 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.040384 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.040497 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.040546 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:44.040862 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 18:38:44.041044 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":87,"threads_started":1}
I20260808 18:38:44.042030 7443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6bdf5a6fd4a3bb33509a3d296e1d6" candidate_uuid: "2c396c6deba64172babf46b28ad0e4d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef" is_pre_election: true
I20260808 18:38:44.042178 7443 raft_consensus.cc:2454] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c396c6deba64172babf46b28ad0e4d2 in term 0.
I20260808 18:38:44.042390 7943 raft_consensus.cc:504] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:44.042752 7943 leader_election.cc:288] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977), 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999)
I20260808 18:38:44.043004 7443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6bdf5a6fd4a3bb33509a3d296e1d6" candidate_uuid: "2c396c6deba64172babf46b28ad0e4d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e74a93e81409087e99543ec40e1ef"
I20260808 18:38:44.043123 7443 raft_consensus.cc:3037] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:44.043130 7684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c6bdf5a6fd4a3bb33509a3d296e1d6" candidate_uuid: "2c396c6deba64172babf46b28ad0e4d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d108561b5c7426abda45699d81c1271"
I20260808 18:38:44.043267 7684 raft_consensus.cc:3037] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:44.044024 7443 raft_consensus.cc:2454] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c396c6deba64172babf46b28ad0e4d2 in term 1.
I20260808 18:38:44.044298 7118 leader_election.cc:302] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c396c6deba64172babf46b28ad0e4d2, 9b5e74a93e81409087e99543ec40e1ef; no voters:
I20260808 18:38:44.044411 7684 raft_consensus.cc:2454] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c396c6deba64172babf46b28ad0e4d2 in term 1.
I20260808 18:38:44.044469 7943 raft_consensus.cc:2781] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:44.044651 7943 raft_consensus.cc:686] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2c396c6deba64172babf46b28ad0e4d2, State: Running, Role: LEADER
I20260808 18:38:44.044891 7943 consensus_queue.cc:237] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } }
I20260808 18:38:44.047327 6983 catalog_manager.cc:5495] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "2c396c6deba64172babf46b28ad0e4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c396c6deba64172babf46b28ad0e4d2" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:44.063623 7975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.059255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.4.61.193:46297)
0808 18:38:44.059554 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:44.059564 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:44.059580 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:38:44.059668 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:44.059671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:44.059759 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:44.060036 (+ 277us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:44.060185 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.061018 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.061856 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.062232 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.062380 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.062582 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:44.063245 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:44.063367 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:44.063399 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 18:38:44.063457 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":117,"threads_started":1}
I20260808 18:38:44.074810 7948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.071404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:57071 (local address 127.4.61.195:36999)
0808 18:38:44.071523 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:44.071528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:44.071674 (+ 146us) server_negotiation.cc:407] Connection header received
0808 18:38:44.071809 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:44.071812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:44.071881 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:44.071952 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:44.072178 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.072772 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.073726 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.073952 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.074037 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.074355 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:44.074425 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:44.074483 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:44.074624 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 18:38:44.074674 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:38:44.074828 7979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.071104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36999 (local address 127.4.61.193:57071)
0808 18:38:44.071385 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:44.071400 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:44.071694 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:44.071966 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:44.071969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:44.071977 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:44.072083 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.072089 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.072866 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.072869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.073613 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.073625 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.074061 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.074065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.074163 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.074205 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:44.074499 (+ 294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:44.074505 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:44.074611 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 18:38:44.074687 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":104,"threads_started":1}
I20260808 18:38:44.080770 7684 raft_consensus.cc:1261] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Refusing update from remote peer 2c396c6deba64172babf46b28ad0e4d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:44.080803 7443 raft_consensus.cc:1261] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Refusing update from remote peer 2c396c6deba64172babf46b28ad0e4d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:44.081250 7970 consensus_queue.cc:1035] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b5e74a93e81409087e99543ec40e1ef" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:44.081427 7943 consensus_queue.cc:1035] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 2c396c6deba64172babf46b28ad0e4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d108561b5c7426abda45699d81c1271" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:44.100049 7952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.096269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46297 (local address 127.4.61.195:42895)
0808 18:38:44.096404 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:44.096419 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:44.096498 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:44.096933 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:44.096937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:44.096945 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:38:44.097053 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.097059 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.097764 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.097767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.098769 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:44.098781 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.099337 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.099341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:44.099420 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.099461 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:38:44.099804 (+ 343us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:38:44.099811 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:38:44.099867 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 18:38:44.099943 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 18:38:44.100059 7975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:44.096489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:42895 (local address 127.4.61.193:46297)
0808 18:38:44.096595 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:44.096600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:44.096612 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:38:44.096657 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:44.096659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:44.096709 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:44.096786 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:44.097148 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.097659 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.098913 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:44.099213 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:44.099568 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:44.099631 (+ 63us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:44.099723 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:44.099784 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:44.099880 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 18:38:44.099936 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 18:38:44.100839 7886 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 18:38:45.657624 6983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:45.657799 6983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:45.660385 6983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a259950863b4faea595dd4f93fbedcc: Sending DeleteTablet for 3 replicas of tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6
I20260808 18:38:45.661016 7645 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:45 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:53876
I20260808 18:38:45.661015 7420 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:45 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:39118
I20260808 18:38:45.661366 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7097
I20260808 18:38:45.668464 8015 tablet_replica.cc:330] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: stopping tablet replica
I20260808 18:38:45.668612 8015 raft_consensus.cc:2229] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:45.668751 8015 raft_consensus.cc:2258] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:45.669229 8014 tablet_replica.cc:330] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: stopping tablet replica
I20260808 18:38:45.669355 8014 raft_consensus.cc:2229] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:45.669474 8014 raft_consensus.cc:2258] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:45.669500 8015 ts_tablet_manager.cc:1905] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:45.670069 8014 ts_tablet_manager.cc:1905] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:45.671816 8015 ts_tablet_manager.cc:1918] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 18:38:45.671891 8015 log.cc:1196] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/c5c6bdf5a6fd4a3bb33509a3d296e1d6
I20260808 18:38:45.672118 8015 ts_tablet_manager.cc:1939] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9b5e74a93e81409087e99543ec40e1ef: Deleting consensus metadata
I20260808 18:38:45.672798 8014 ts_tablet_manager.cc:1918] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 18:38:45.672792 6964 catalog_manager.cc:4841] TS 9b5e74a93e81409087e99543ec40e1ef (127.4.61.194:32977): tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 (table test-table [id=397b6b195dff4bb79919ad409e34cad6]) successfully deleted
I20260808 18:38:45.672878 8014 log.cc:1196] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/c5c6bdf5a6fd4a3bb33509a3d296e1d6
I20260808 18:38:45.673130 8014 ts_tablet_manager.cc:1939] T c5c6bdf5a6fd4a3bb33509a3d296e1d6 P 9d108561b5c7426abda45699d81c1271: Deleting consensus metadata
I20260808 18:38:45.673801 6965 catalog_manager.cc:4841] TS 9d108561b5c7426abda45699d81c1271 (127.4.61.195:36999): tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6 (table test-table [id=397b6b195dff4bb79919ad409e34cad6]) successfully deleted
W20260808 18:38:45.678678 6964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:46297 (error 108)
I20260808 18:38:45.678853 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7316
I20260808 18:38:45.684386 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:45.682465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46297 (local address 127.0.0.1:38618)
0808 18:38:45.684188 (+ 1723us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:45.684272 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1636,"thread_start_us":452,"threads_started":1}
W20260808 18:38:45.684486 6964 catalog_manager.cc:4584] TS 2c396c6deba64172babf46b28ad0e4d2 (127.4.61.193:46297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5c6bdf5a6fd4a3bb33509a3d296e1d6: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46297: connect: Connection refused (error 111)
I20260808 18:38:45.696563 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7538
I20260808 18:38:45.707351 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6937
2026-08-08T18:38:45Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6234 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:45 dist-test-slave-fgb3 krb5kdc[8026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:45 dist-test-slave-fgb3 krb5kdc[8026](info): set up 2 sockets
Aug 08 18:38:45 dist-test-slave-fgb3 krb5kdc[8026](info): commencing operation
krb5kdc: starting...
W20260808 18:38:46.852283 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:46 dist-test-slave-fgb3 krb5kdc[8026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:46.974864 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:46229
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:46229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:47.087809 8046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:47.088079 8046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:47.088119 8046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:47.092074 8046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:47.092129 8046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:47.092149 8046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:47.092162 8046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:47.092176 8046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:47.097426 8046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:46229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:46229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:47.098479 8046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:47.099474 8046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:47.107546 8056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.107605 8052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:47.107690 8046 server_base.cc:1034] running on GCE node
W20260808 18:38:47.108886 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:47.109442 8046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:47.110533 8046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:47.111689 8046 hybrid_clock.cc:648] HybridClock initialized: now 1786214327111670 us; error 30 us; skew 500 ppm
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:47.117763 8046 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:47.118700 8046 webserver.cc:460] Webserver started at http://127.4.61.254:36677/ using document root <none> and password file <none>
I20260808 18:38:47.119211 8046 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:47.119269 8046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:47.119428 8046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:47.121352 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "7388407805a74b8b92b902efa3c40e6b"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "5283fac79864371fc166ff829350b26f"
server_key_iv: "ba9bc9ba7060b2188bf0da422831272b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.121855 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "7388407805a74b8b92b902efa3c40e6b"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "5283fac79864371fc166ff829350b26f"
server_key_iv: "ba9bc9ba7060b2188bf0da422831272b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.125422 8046 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:47.127746 8068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.128952 8046 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:47.129051 8046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "7388407805a74b8b92b902efa3c40e6b"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "5283fac79864371fc166ff829350b26f"
server_key_iv: "ba9bc9ba7060b2188bf0da422831272b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.129130 8046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:47.140726 8046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:47.143329 8046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:47.143472 8046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:47.149783 8046 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:46229
I20260808 18:38:47.149839 8141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:46229 every 8 connection(s)
I20260808 18:38:47.150738 8046 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:47.153414 8142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:47.158883 8142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b: Bootstrap starting.
I20260808 18:38:47.160837 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8046
I20260808 18:38:47.160956 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:47.161237 4343 external_mini_cluster.cc:1428] Setting key 78a9d0edb24e1d35eb4cd5a8b97a9845
I20260808 18:38:47.161559 8142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:47.162452 8142 log.cc:824] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:47.164352 8142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b: No bootstrap required, opened a new log
I20260808 18:38:47.167755 8142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } }
I20260808 18:38:47.167990 8142 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:47.168049 8142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7388407805a74b8b92b902efa3c40e6b, State: Initialized, Role: FOLLOWER
I20260808 18:38:47.168478 8142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } }
I20260808 18:38:47.168603 8142 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:47.168661 8142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:47.168757 8142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:47.169598 8142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } }
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:47.169948 8142 leader_election.cc:302] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7388407805a74b8b92b902efa3c40e6b; no voters:
I20260808 18:38:47.170296 8142 leader_election.cc:288] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:47.170418 8150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:47.170657 8150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [term 1 LEADER]: Becoming Leader. State: Replica: 7388407805a74b8b92b902efa3c40e6b, State: Running, Role: LEADER
I20260808 18:38:47.171041 8150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } }
I20260808 18:38:47.171613 8142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:47.173035 8151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7388407805a74b8b92b902efa3c40e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } } }
I20260808 18:38:47.173157 8151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:47.173560 8153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7388407805a74b8b92b902efa3c40e6b. Latest consensus state: current_term: 1 leader_uuid: "7388407805a74b8b92b902efa3c40e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7388407805a74b8b92b902efa3c40e6b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46229 } } }
I20260808 18:38:47.173913 8167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:47.174279 8153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:47.176182 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.162469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.4.61.254:46229)
0808 18:38:47.162933 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:47.162954 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:47.162999 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:38:47.163721 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:47.163741 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:47.164061 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:47.164370 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:47.165187 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.166177 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.167067 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.167542 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.167689 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.170408 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:47.170416 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:47.170434 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:47.170469 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:47.172464 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.172951 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.172958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.172965 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.173116 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.173445 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.173448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.173450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.173992 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:47.174196 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:47.174973 (+ 777us) server_negotiation.cc:299] Negotiation successful
0808 18:38:47.175268 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":140,"threads_started":1}
I20260808 18:38:47.177284 8167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:47.182581 8167 catalog_manager.cc:1347] Generated new cluster ID: 3394d37f95304f6c9eab3ebbd4e4afa0
I20260808 18:38:47.182641 8167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:47.200019 8167 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:47.201256 8167 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:47.212517 8167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7388407805a74b8b92b902efa3c40e6b: Generated new TSK 0
I20260808 18:38:47.213231 8167 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:47.249511 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:47.378381 8183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:47.378621 8183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:47.378664 8183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:47.382512 8183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:47.382556 8183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:47.382611 8183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:47.387591 8183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:47.388545 8183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:47.389489 8183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:47.398692 8190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.398701 8193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.398702 8189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:47.399121 8183 server_base.cc:1034] running on GCE node
I20260808 18:38:47.399497 8183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:47.400108 8183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:47.401264 8183 hybrid_clock.cc:648] HybridClock initialized: now 1786214327401249 us; error 30 us; skew 500 ppm
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:47.403982 8183 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:47.404850 8183 webserver.cc:460] Webserver started at http://127.4.61.193:41543/ using document root <none> and password file <none>
I20260808 18:38:47.405398 8183 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:47.405465 8183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:47.405678 8183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:47.407819 8183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "6af4785bd5fa4c3e899cc07afbbc9685"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "fcfe1a14422fb1889aa74060fb17e457"
server_key_iv: "c50edb249b2cde8117ba2fe332dba7c6"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.408380 8183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "6af4785bd5fa4c3e899cc07afbbc9685"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "fcfe1a14422fb1889aa74060fb17e457"
server_key_iv: "c50edb249b2cde8117ba2fe332dba7c6"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.412070 8183 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:38:47.414521 8202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.415700 8183 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:47.415820 8183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "6af4785bd5fa4c3e899cc07afbbc9685"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "fcfe1a14422fb1889aa74060fb17e457"
server_key_iv: "c50edb249b2cde8117ba2fe332dba7c6"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.415918 8183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:47.431991 8183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:47.435189 8183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:47.435372 8183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:47.435971 8183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:47.436848 8183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:47.436898 8183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.436954 8183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:47.436980 8183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.445600 8183 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:38337
I20260808 18:38:47.445627 8365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:38337 every 8 connection(s)
I20260808 18:38:47.446487 8183 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:47.447127 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8183
I20260808 18:38:47.447250 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:47.447521 4343 external_mini_cluster.cc:1428] Setting key d6d4303e68059ba2b08d6a4ad13dce7d
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:38:47.460517 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.448294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:41457 (local address 127.4.61.254:46229)
0808 18:38:47.448414 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:47.448418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:47.449402 (+ 984us) server_negotiation.cc:407] Connection header received
0808 18:38:47.450810 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:47.450814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:47.450867 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:47.450944 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:47.452114 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.452646 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.453880 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.454109 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.454200 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.456675 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:47.456678 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:47.456680 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:47.456706 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:47.458089 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.458647 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.458650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.458652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.458737 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.459172 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.459175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.459177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.459398 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:47.459494 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:47.460202 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 18:38:47.460343 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 18:38:47.461279 8369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.448745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:46229 (local address 127.4.61.193:41457)
0808 18:38:47.449255 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:47.449301 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:47.450606 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:47.451130 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:47.451137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:47.451483 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:47.451969 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.451983 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.452776 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.452778 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.453762 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.453773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.454255 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.454259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.454465 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.455071 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:47.455088 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:47.456510 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:47.458198 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.458204 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.458221 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.458549 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.458821 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.458824 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.458826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.459068 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.459530 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:47.459537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:47.459876 (+ 339us) client_negotiation.cc:769] Sending connection context
0808 18:38:47.460064 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 18:38:47.460372 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":140,"threads_started":1}
I20260808 18:38:47.462683 8367 heartbeater.cc:347] Connected to a master server at 127.4.61.254:46229
I20260808 18:38:47.462937 8367 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:47.463449 8367 heartbeater.cc:511] Master 127.4.61.254:46229 requested a full tablet report, sending...
I20260808 18:38:47.465036 8090 ts_manager.cc:194] Registered new tserver with Master: 6af4785bd5fa4c3e899cc07afbbc9685 (127.4.61.193:38337)
I20260808 18:38:47.466148 8090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:41457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:47.475174 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:47.586673 8373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:47.586943 8373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:47.587005 8373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:47.591017 8373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:47.591084 8373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:47.591166 8373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:47.596484 8373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:47.597525 8373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:47.598595 8373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:47.607728 8380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.607728 8386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.607798 8381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:47.607944 8373 server_base.cc:1034] running on GCE node
I20260808 18:38:47.608464 8373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:47.609066 8373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:47.610231 8373 hybrid_clock.cc:648] HybridClock initialized: now 1786214327610210 us; error 31 us; skew 500 ppm
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:47.612763 8373 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:47.613662 8373 webserver.cc:460] Webserver started at http://127.4.61.194:39563/ using document root <none> and password file <none>
I20260808 18:38:47.614200 8373 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:47.614265 8373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:47.614490 8373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:47.616487 8373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "08dd4ce419ed4a4a8dc2065bfd0dc0a1"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "cfe916beda065348160de593e041ea8f"
server_key_iv: "df66f840c7ac117cfc85e0855f88cc4b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.617041 8373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "08dd4ce419ed4a4a8dc2065bfd0dc0a1"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "cfe916beda065348160de593e041ea8f"
server_key_iv: "df66f840c7ac117cfc85e0855f88cc4b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.620707 8373 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 18:38:47.623018 8398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.624146 8373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:38:47.624255 8373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "08dd4ce419ed4a4a8dc2065bfd0dc0a1"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "cfe916beda065348160de593e041ea8f"
server_key_iv: "df66f840c7ac117cfc85e0855f88cc4b"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.624349 8373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:47.635537 8373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:47.638285 8373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:47.638530 8373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:47.639104 8373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:47.639930 8373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:47.639976 8373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.640015 8373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:47.640044 8373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.648502 8373 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:41941
I20260808 18:38:47.648528 8572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:41941 every 8 connection(s)
I20260808 18:38:47.649324 8373 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:47.651589 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8373
I20260808 18:38:47.651683 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:47.652014 4343 external_mini_cluster.cc:1428] Setting key e5c33c94f02c79623c27cfb9ca6bc0a5
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:47.663794 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.651160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49993 (local address 127.4.61.254:46229)
0808 18:38:47.651360 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:47.651365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:47.652264 (+ 899us) server_negotiation.cc:407] Connection header received
0808 18:38:47.653805 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:47.653815 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:47.653860 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:47.653923 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:47.655455 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.655979 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.657506 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.657720 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.657823 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.660338 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:47.660342 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:47.660344 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:47.660368 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:47.661619 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.662184 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.662187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.662188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.662265 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.662698 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.662702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.662704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.662910 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:47.663016 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:47.663503 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 18:38:47.663626 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 18:38:47.664558 8576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.651582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:46229 (local address 127.4.61.194:49993)
0808 18:38:47.652096 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:47.652152 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:47.653583 (+ 1431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:47.654115 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:47.654124 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:47.654643 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:47.655287 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.655305 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.656101 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.656105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.657395 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.657406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.657884 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.657889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.658072 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.658638 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:47.658654 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:47.660168 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:47.661733 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.661741 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.661756 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.662088 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.662379 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.662382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.662384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.662565 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.663029 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:47.663036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:47.663269 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 18:38:47.663438 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 18:38:47.663750 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:38:47.665697 8573 heartbeater.cc:347] Connected to a master server at 127.4.61.254:46229
I20260808 18:38:47.665969 8573 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:47.666559 8573 heartbeater.cc:511] Master 127.4.61.254:46229 requested a full tablet report, sending...
I20260808 18:38:47.667707 8090 ts_manager.cc:194] Registered new tserver with Master: 08dd4ce419ed4a4a8dc2065bfd0dc0a1 (127.4.61.194:41941)
I20260808 18:38:47.668251 8090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:49993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:47.680807 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:47.794018 8580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:47.794283 8580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:47.794373 8580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:47.798540 8580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:47.798602 8580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:47.798677 8580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:47.803897 8580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:46229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:47.804963 8580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:47.805979 8580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:47.815452 8588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.815462 8590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:47.815475 8587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:47.815815 8580 server_base.cc:1034] running on GCE node
I20260808 18:38:47.816205 8580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:47.816859 8580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:47.818028 8580 hybrid_clock.cc:648] HybridClock initialized: now 1786214327818012 us; error 35 us; skew 500 ppm
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:47.820802 8580 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:47.821676 8580 webserver.cc:460] Webserver started at http://127.4.61.195:38981/ using document root <none> and password file <none>
I20260808 18:38:47.822219 8580 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:47.822288 8580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:47.822546 8580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:47.824612 8580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "c758aa58d57e484c8f8bf59c9f1ac594"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "0718d067952b99fbf79511459033a74d"
server_key_iv: "49a10fcdae94b14bfeb271f2f19bc2c5"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.825170 8580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "c758aa58d57e484c8f8bf59c9f1ac594"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "0718d067952b99fbf79511459033a74d"
server_key_iv: "49a10fcdae94b14bfeb271f2f19bc2c5"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.829229 8580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 18:38:47.831835 8601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.833097 8580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:47.833210 8580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "c758aa58d57e484c8f8bf59c9f1ac594"
format_stamp: "Formatted at 2026-08-08 18:38:47 on dist-test-slave-fgb3"
server_key: "0718d067952b99fbf79511459033a74d"
server_key_iv: "49a10fcdae94b14bfeb271f2f19bc2c5"
server_key_version: "encryptionkey@0"
I20260808 18:38:47.833312 8580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:47.852962 8580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:47.856032 8580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:47.856227 8580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:47.856868 8580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:47.857767 8580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:47.857818 8580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.857873 8580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:47.857903 8580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:47.866645 8580 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:35019
I20260808 18:38:47.866673 8767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:35019 every 8 connection(s)
I20260808 18:38:47.867525 8580 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:47.867790 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8580
I20260808 18:38:47.867923 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:47.868254 4343 external_mini_cluster.cc:1428] Setting key 2d32fa4dbf01b3d1ddbf3b6fba198d67
Aug 08 18:38:47 dist-test-slave-fgb3 krb5kdc[8026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214327, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:47.881755 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.869495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:51225 (local address 127.4.61.254:46229)
0808 18:38:47.869660 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:47.869665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:47.870894 (+ 1229us) server_negotiation.cc:407] Connection header received
0808 18:38:47.872650 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:47.872654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:47.872710 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:47.872769 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:47.874162 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.874760 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.875891 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.876117 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.876206 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.878598 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:47.878602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:47.878605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:47.878632 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:47.879708 (+ 1076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.880172 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.880176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.880177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.880264 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:47.880573 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:47.880577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:47.880578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:47.880754 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:47.880841 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:47.881465 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 18:38:47.881592 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 18:38:47.882716 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:47.869962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:46229 (local address 127.4.61.195:51225)
0808 18:38:47.870742 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:47.870811 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:47.872350 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:47.873106 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:47.873112 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:47.873462 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:47.874025 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.874039 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.874889 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.874892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.875775 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:47.875785 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:47.876257 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:47.876261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:47.876430 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:47.876913 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:47.876930 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:47.878445 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:47.879817 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.879823 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.879839 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.880080 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.880346 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:47.880349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:47.880351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:47.880485 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:47.880853 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:47.880860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:47.881179 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 18:38:47.881389 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 18:38:47.881705 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":126,"threads_started":1}
I20260808 18:38:47.883705 8768 heartbeater.cc:347] Connected to a master server at 127.4.61.254:46229
I20260808 18:38:47.883937 8768 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:47.884426 8768 heartbeater.cc:511] Master 127.4.61.254:46229 requested a full tablet report, sending...
I20260808 18:38:47.885396 8090 ts_manager.cc:194] Registered new tserver with Master: c758aa58d57e484c8f8bf59c9f1ac594 (127.4.61.195:35019)
I20260808 18:38:47.885951 8090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:51225
I20260808 18:38:47.894687 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 18:38:47.909332 8145 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:38:47.907940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51176 (local address 127.4.61.254:46229)
0808 18:38:47.908062 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:47.908066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:47.908274 (+ 208us) server_negotiation.cc:407] Connection header received
0808 18:38:47.908403 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:47.908406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:47.908448 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:47.908521 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:47.909215 (+ 694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51176: BlockingRecv error: recv got EOF from 127.0.0.1:51176 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:38:47.910411 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8183
I20260808 18:38:47.932802 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8373
I20260808 18:38:47.942970 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8580
I20260808 18:38:47.954291 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8046
2026-08-08T18:38:47Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2240 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:48 dist-test-slave-fgb3 krb5kdc[8787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:48 dist-test-slave-fgb3 krb5kdc[8787](info): set up 2 sockets
Aug 08 18:38:48 dist-test-slave-fgb3 krb5kdc[8787](info): commencing operation
krb5kdc: starting...
W20260808 18:38:49.099819 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:49.221177 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42417
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:42417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:49.339179 8805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:49.339562 8805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:49.339658 8805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:49.344341 8805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:49.344413 8805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:49.344442 8805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:49.344473 8805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:49.344501 8805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:49.350304 8805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:42417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:49.351454 8805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:49.352473 8805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:49.360896 8816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:49.360903 8811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:49.360903 8813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:49.361105 8805 server_base.cc:1034] running on GCE node
I20260808 18:38:49.361791 8805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:49.362922 8805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:49.364108 8805 hybrid_clock.cc:648] HybridClock initialized: now 1786214329364084 us; error 33 us; skew 500 ppm
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:49.366775 8805 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:49.367763 8805 webserver.cc:460] Webserver started at http://127.4.61.254:40455/ using document root <none> and password file <none>
I20260808 18:38:49.368278 8805 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:49.368335 8805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:49.368507 8805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:49.370532 8805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec"
format_stamp: "Formatted at 2026-08-08 18:38:49 on dist-test-slave-fgb3"
server_key: "aa5ff34fc57aba50d38123211d81dc18"
server_key_iv: "98bc8df1190ada096e6bd546f3199d6a"
server_key_version: "encryptionkey@0"
I20260808 18:38:49.371037 8805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec"
format_stamp: "Formatted at 2026-08-08 18:38:49 on dist-test-slave-fgb3"
server_key: "aa5ff34fc57aba50d38123211d81dc18"
server_key_iv: "98bc8df1190ada096e6bd546f3199d6a"
server_key_version: "encryptionkey@0"
I20260808 18:38:49.374629 8805 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:38:49.377038 8824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:49.378348 8805 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:49.378492 8805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec"
format_stamp: "Formatted at 2026-08-08 18:38:49 on dist-test-slave-fgb3"
server_key: "aa5ff34fc57aba50d38123211d81dc18"
server_key_iv: "98bc8df1190ada096e6bd546f3199d6a"
server_key_version: "encryptionkey@0"
I20260808 18:38:49.378590 8805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:49.415454 8805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:49.418306 8805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:49.418525 8805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:49.425892 8805 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:42417
I20260808 18:38:49.426172 8900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:42417 every 8 connection(s)
I20260808 18:38:49.426926 8805 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:49.428190 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8805
I20260808 18:38:49.428330 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:49.428648 4343 external_mini_cluster.cc:1428] Setting key 8075d965ef50907af9ab090b37abf632
I20260808 18:38:49.430249 8901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:49.436645 8901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec: Bootstrap starting.
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:49.439093 8901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:49.439801 8901 log.cc:824] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:49.441697 8901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec: No bootstrap required, opened a new log
I20260808 18:38:49.442385 8905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:49.429970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.4.61.254:42417)
0808 18:38:49.430411 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:49.430428 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:49.430465 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:38:49.431118 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:49.431135 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:49.431468 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:49.431741 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:49.432632 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:49.433629 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:49.434803 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:49.435271 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:49.435398 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:49.438010 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:49.438015 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:49.438029 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:49.438057 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:49.439636 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:49.440067 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:49.440073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:49.440077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:49.440192 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:49.440454 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:49.440458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:49.440459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:49.440852 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:49.441039 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:49.441327 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 18:38:49.441616 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":112,"threads_started":1}
I20260808 18:38:49.445286 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:38:49.445600 8901 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } }
I20260808 18:38:49.445832 8901 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:49.445891 8901 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fc89c7b1f6042cbbcfc6b57a94c5bec, State: Initialized, Role: FOLLOWER
I20260808 18:38:49.446305 8901 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } }
I20260808 18:38:49.446489 8901 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:49.446555 8901 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:49.446650 8901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:49.447513 8901 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } }
I20260808 18:38:49.447835 8901 leader_election.cc:302] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fc89c7b1f6042cbbcfc6b57a94c5bec; no voters:
I20260808 18:38:49.448117 8901 leader_election.cc:288] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:49.448207 8909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:49.448385 8909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [term 1 LEADER]: Becoming Leader. State: Replica: 0fc89c7b1f6042cbbcfc6b57a94c5bec, State: Running, Role: LEADER
I20260808 18:38:49.448740 8909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } }
I20260808 18:38:49.449373 8901 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:49.450376 8911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fc89c7b1f6042cbbcfc6b57a94c5bec. Latest consensus state: current_term: 1 leader_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } } }
I20260808 18:38:49.450520 8911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:49.450927 8919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:49.450883 8910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fc89c7b1f6042cbbcfc6b57a94c5bec" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42417 } } }
I20260808 18:38:49.451057 8910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:49.454131 8919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:49.460172 8919 catalog_manager.cc:1347] Generated new cluster ID: fa790df326ef403a99e80cfc1492c886
I20260808 18:38:49.460301 8919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:49.466763 8905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:49.462544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57168 (local address 127.4.61.254:42417)
0808 18:38:49.462664 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:49.462668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:49.462681 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:38:49.462722 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:49.462725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:49.462766 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:49.462829 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:49.463352 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:49.463867 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:49.464709 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:49.464952 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:49.465041 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:49.465887 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:49.465891 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:49.465894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:49.466292 (+ 398us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:49.466364 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:49.466387 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:49.466478 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:49.466560 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 18:38:49.466623 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:38:49.471755 8919 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:49.472602 8919 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:49.481127 8919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fc89c7b1f6042cbbcfc6b57a94c5bec: Generated new TSK 0
I20260808 18:38:49.481813 8919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:38:49.489355 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8805
2026-08-08T18:38:49Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1537 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8947](info): set up 2 sockets
Aug 08 18:38:49 dist-test-slave-fgb3 krb5kdc[8947](info): commencing operation
krb5kdc: starting...
W20260808 18:38:50.633438 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:50 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:50.753088 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37537
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:37537
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:50.864269 8968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:50.864570 8968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:50.864611 8968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:50.868673 8968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:50.868736 8968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:50.868754 8968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:50.868770 8968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:50.868783 8968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:50.874117 8968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:37537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:50.875228 8968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:50.876255 8968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:50.884781 8976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:50.884802 8975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:50.884826 8968 server_base.cc:1034] running on GCE node
W20260808 18:38:50.884781 8978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:50.885555 8968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:50.886646 8968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:50.887802 8968 hybrid_clock.cc:648] HybridClock initialized: now 1786214330887778 us; error 36 us; skew 500 ppm
Aug 08 18:38:50 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214330, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:50.890866 8968 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:50.891850 8968 webserver.cc:460] Webserver started at http://127.4.61.254:34891/ using document root <none> and password file <none>
I20260808 18:38:50.892402 8968 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:50.892462 8968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:50.892658 8968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:50.894775 8968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "d9ee1b673eb645a6ab5608ae3cb860ce"
format_stamp: "Formatted at 2026-08-08 18:38:50 on dist-test-slave-fgb3"
server_key: "2cf11755dd664808476a3acf9e5abbbc"
server_key_iv: "004f91d58854e88365e003d6b7736c0e"
server_key_version: "encryptionkey@0"
I20260808 18:38:50.895296 8968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "d9ee1b673eb645a6ab5608ae3cb860ce"
format_stamp: "Formatted at 2026-08-08 18:38:50 on dist-test-slave-fgb3"
server_key: "2cf11755dd664808476a3acf9e5abbbc"
server_key_iv: "004f91d58854e88365e003d6b7736c0e"
server_key_version: "encryptionkey@0"
I20260808 18:38:50.898928 8968 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:38:50.901329 8986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:50.902522 8968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:50.902647 8968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "d9ee1b673eb645a6ab5608ae3cb860ce"
format_stamp: "Formatted at 2026-08-08 18:38:50 on dist-test-slave-fgb3"
server_key: "2cf11755dd664808476a3acf9e5abbbc"
server_key_iv: "004f91d58854e88365e003d6b7736c0e"
server_key_version: "encryptionkey@0"
I20260808 18:38:50.902750 8968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:50.939756 8968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:50.942850 8968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:50.943015 8968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:50.949759 8968 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:37537
I20260808 18:38:50.950039 9068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:37537 every 8 connection(s)
I20260808 18:38:50.950716 8968 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:50.953470 9069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:50.959184 9069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce: Bootstrap starting.
I20260808 18:38:50.960170 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 8968
I20260808 18:38:50.960314 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:50.960629 4343 external_mini_cluster.cc:1428] Setting key 06db3d7ff74c62226d4010e5b4709196
I20260808 18:38:50.962124 9069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:50.962913 9069 log.cc:824] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:50.965008 9069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce: No bootstrap required, opened a new log
I20260808 18:38:50.969004 9069 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } }
I20260808 18:38:50.969295 9069 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:50.969377 9069 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9ee1b673eb645a6ab5608ae3cb860ce, State: Initialized, Role: FOLLOWER
Aug 08 18:38:50 dist-test-slave-fgb3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:50.969833 9069 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } }
I20260808 18:38:50.969973 9069 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:50.970044 9069 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:50.970149 9069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:50.971323 9069 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } }
I20260808 18:38:50.971699 9069 leader_election.cc:302] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9ee1b673eb645a6ab5608ae3cb860ce; no voters:
I20260808 18:38:50.972057 9069 leader_election.cc:288] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:50.972153 9076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:50.972388 9076 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [term 1 LEADER]: Becoming Leader. State: Replica: d9ee1b673eb645a6ab5608ae3cb860ce, State: Running, Role: LEADER
I20260808 18:38:50.972723 9076 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } }
I20260808 18:38:50.973363 9069 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:50.974016 9078 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9ee1b673eb645a6ab5608ae3cb860ce. Latest consensus state: current_term: 1 leader_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } } }
I20260808 18:38:50.974148 9078 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:50.974572 9087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:50.974567 9079 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9ee1b673eb645a6ab5608ae3cb860ce" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37537 } } }
I20260808 18:38:50.975400 9079 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:50.975805 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:50.961823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.4.61.254:37537)
0808 18:38:50.962223 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:50.962249 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:50.962293 (+ 44us) server_negotiation.cc:407] Connection header received
0808 18:38:50.962951 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:50.962967 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:50.963315 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:50.963599 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:50.964300 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:50.965738 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:50.966645 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:50.967382 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:50.967543 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:50.970113 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:50.970120 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:50.970136 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:50.970172 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:50.972053 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:50.972613 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:50.972620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:50.972625 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:50.972773 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:50.973097 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:50.973101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:50.973103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:50.973644 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:50.973863 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:50.974566 (+ 703us) server_negotiation.cc:299] Negotiation successful
0808 18:38:50.974857 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":108,"threads_started":1}
I20260808 18:38:50.977859 9087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:50.984190 9087 catalog_manager.cc:1347] Generated new cluster ID: 90523f5eee7a4be5ab2f9d617988924f
I20260808 18:38:50.984258 9087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:51.000670 9087 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:51.001698 9087 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:51.007874 9087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9ee1b673eb645a6ab5608ae3cb860ce: Generated new TSK 0
I20260808 18:38:51.008620 9087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:51.044801 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:51.189968 9114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:51.190248 9114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:51.190339 9114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:51.194386 9114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:51.194453 9114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:51.194535 9114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:51.199864 9114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:51.200953 9114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:51.201987 9114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:51.211710 9123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:51.211710 9125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:51.211751 9122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:51.212149 9114 server_base.cc:1034] running on GCE node
I20260808 18:38:51.212581 9114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:51.213250 9114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:51.214385 9114 hybrid_clock.cc:648] HybridClock initialized: now 1786214331214362 us; error 34 us; skew 500 ppm
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:51.217180 9114 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:51.218096 9114 webserver.cc:460] Webserver started at http://127.4.61.193:42549/ using document root <none> and password file <none>
I20260808 18:38:51.218694 9114 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:51.218758 9114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:51.218954 9114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:51.221024 9114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "a41ef9893492416499894c185fde2cc6"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "90051ae1f025fa36d260e9bc8e6f98ab"
server_key_iv: "e287db8aa4b2f18415f02b46ef6b8817"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.221590 9114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "a41ef9893492416499894c185fde2cc6"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "90051ae1f025fa36d260e9bc8e6f98ab"
server_key_iv: "e287db8aa4b2f18415f02b46ef6b8817"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.225298 9114 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:38:51.227722 9135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.228888 9114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:38:51.229004 9114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "a41ef9893492416499894c185fde2cc6"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "90051ae1f025fa36d260e9bc8e6f98ab"
server_key_iv: "e287db8aa4b2f18415f02b46ef6b8817"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.229100 9114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:51.239746 9114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:51.242844 9114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:51.243021 9114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:51.243594 9114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:51.244433 9114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:51.244480 9114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.244532 9114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:51.244560 9114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.253289 9114 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:38235
I20260808 18:38:51.253310 9303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:38235 every 8 connection(s)
I20260808 18:38:51.254133 9114 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:51.263120 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 9114
I20260808 18:38:51.263252 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:51.263576 4343 external_mini_cluster.cc:1428] Setting key ba2f30cbda0fd01cf84ac396a445b281
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:51.267771 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.256026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:54313 (local address 127.4.61.254:37537)
0808 18:38:51.256165 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:51.256170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:51.257074 (+ 904us) server_negotiation.cc:407] Connection header received
0808 18:38:51.258499 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:51.258502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:51.258548 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:51.258619 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:51.259780 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.260330 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.261398 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.261624 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.261697 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.264183 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:51.264187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:51.264190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:51.264217 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:51.265857 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.266346 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.266349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.266351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.266426 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.266738 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.266742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.266744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.266910 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:51.266993 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:51.267483 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 18:38:51.267600 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:38:51.268522 9306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.256453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37537 (local address 127.4.61.193:54313)
0808 18:38:51.256926 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:51.256971 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:51.258261 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:51.258784 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:51.258790 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:51.259147 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:51.259635 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.259648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.260428 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.260430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.261305 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.261314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.261736 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.261738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.261883 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.262418 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:51.262433 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:51.264013 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:51.265965 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.265971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.265986 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.266226 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.266511 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.266514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.266516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.266646 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.267011 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:51.267017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:51.267261 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 18:38:51.267428 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 18:38:51.267730 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":126,"threads_started":1}
I20260808 18:38:51.269690 9304 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37537
I20260808 18:38:51.269945 9304 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:51.270555 9304 heartbeater.cc:511] Master 127.4.61.254:37537 requested a full tablet report, sending...
I20260808 18:38:51.272294 9012 ts_manager.cc:194] Registered new tserver with Master: a41ef9893492416499894c185fde2cc6 (127.4.61.193:38235)
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:51.273896 9012 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:54313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:51.292929 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:51.404636 9312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:51.404896 9312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:51.404944 9312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:51.409106 9312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:51.409166 9312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:51.409225 9312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:51.414420 9312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:51.415434 9312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:51.416442 9312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:51.426080 9323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:51.426092 9318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:51.426193 9312 server_base.cc:1034] running on GCE node
W20260808 18:38:51.426121 9320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:51.426870 9312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:51.427495 9312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:51.428656 9312 hybrid_clock.cc:648] HybridClock initialized: now 1786214331428632 us; error 31 us; skew 500 ppm
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:51.434845 9312 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:51.435755 9312 webserver.cc:460] Webserver started at http://127.4.61.194:43441/ using document root <none> and password file <none>
I20260808 18:38:51.436329 9312 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:51.436399 9312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:51.436604 9312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:51.438769 9312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "c369016ee42f49ff9aa1b43eed34c17a"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "9cb1c56fab711ca531900706a3588c30"
server_key_iv: "4261143f170633e3fe74aabc8ef1400f"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.439345 9312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "c369016ee42f49ff9aa1b43eed34c17a"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "9cb1c56fab711ca531900706a3588c30"
server_key_iv: "4261143f170633e3fe74aabc8ef1400f"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.443244 9312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 18:38:51.445792 9336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.447089 9312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:51.447206 9312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "c369016ee42f49ff9aa1b43eed34c17a"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "9cb1c56fab711ca531900706a3588c30"
server_key_iv: "4261143f170633e3fe74aabc8ef1400f"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.447311 9312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:51.462455 9312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:51.465580 9312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:51.465767 9312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:51.466415 9312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:51.467260 9312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:51.467310 9312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.467363 9312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:51.467392 9312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.476300 9312 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:43029
I20260808 18:38:51.476339 9496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:43029 every 8 connection(s)
I20260808 18:38:51.477169 9312 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:51.479400 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 9312
I20260808 18:38:51.479491 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:51.479825 4343 external_mini_cluster.cc:1428] Setting key b69bef45815b368f1bba2d2c8972a61a
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:51.494714 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.479020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:33971 (local address 127.4.61.254:37537)
0808 18:38:51.479136 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:51.479139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:51.480054 (+ 915us) server_negotiation.cc:407] Connection header received
0808 18:38:51.482056 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:51.482060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:51.482116 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:51.482203 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:51.483795 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.484319 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.485552 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.485869 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.485940 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.489501 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:51.489504 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:51.489507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:51.489533 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:51.491885 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.492810 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.492814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.492816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.492931 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.493364 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.493368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.493370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.493590 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:51.493687 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:51.494391 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 18:38:51.494539 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:38:51.495952 9501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.479370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37537 (local address 127.4.61.194:33971)
0808 18:38:51.479889 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:51.479946 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:51.481793 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:51.482431 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:51.482441 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:51.482913 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:51.483597 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.483618 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.484440 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.484443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.485419 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.485430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.486135 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.486138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.486364 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.487083 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:51.487106 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:51.489321 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:51.492051 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.492059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.492090 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.492423 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.493050 (+ 627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.493054 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.493056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.493259 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.493701 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:51.493709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:51.494082 (+ 373us) client_negotiation.cc:769] Sending connection context
0808 18:38:51.494359 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 18:38:51.494770 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":141,"threads_started":1}
I20260808 18:38:51.497671 9497 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37537
I20260808 18:38:51.497939 9497 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:51.498608 9497 heartbeater.cc:511] Master 127.4.61.254:37537 requested a full tablet report, sending...
I20260808 18:38:51.499953 9012 ts_manager.cc:194] Registered new tserver with Master: c369016ee42f49ff9aa1b43eed34c17a (127.4.61.194:43029)
I20260808 18:38:51.500783 9012 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:33971
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:51.513195 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:51.634428 9505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:51.634696 9505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:51.634742 9505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:51.638748 9505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:51.638808 9505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:51.638865 9505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:51.644071 9505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:51.645118 9505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:51.646149 9505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:51.655509 9517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:51.655570 9513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:51.655525 9511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:51.655747 9505 server_base.cc:1034] running on GCE node
I20260808 18:38:51.656206 9505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:51.656816 9505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:51.658004 9505 hybrid_clock.cc:648] HybridClock initialized: now 1786214331657965 us; error 51 us; skew 500 ppm
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:51.660710 9505 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:51.661589 9505 webserver.cc:460] Webserver started at http://127.4.61.195:44181/ using document root <none> and password file <none>
I20260808 18:38:51.662133 9505 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:51.662201 9505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:51.662444 9505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:51.664492 9505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "95b367e409a14d108867a6ec352d2736"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "7ffca5552d1de99fad0cc68ad50da2be"
server_key_iv: "05a10f4054daf5b5675351052d5ea9ae"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.665051 9505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "95b367e409a14d108867a6ec352d2736"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "7ffca5552d1de99fad0cc68ad50da2be"
server_key_iv: "05a10f4054daf5b5675351052d5ea9ae"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.668885 9505 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 18:38:51.671362 9528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.672550 9505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:51.672665 9505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "95b367e409a14d108867a6ec352d2736"
format_stamp: "Formatted at 2026-08-08 18:38:51 on dist-test-slave-fgb3"
server_key: "7ffca5552d1de99fad0cc68ad50da2be"
server_key_iv: "05a10f4054daf5b5675351052d5ea9ae"
server_key_version: "encryptionkey@0"
I20260808 18:38:51.672777 9505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:51.683487 9505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:51.686167 9505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:51.686376 9505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:51.687095 9505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:51.688022 9505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:51.688069 9505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.688107 9505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:51.688126 9505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:51.696946 9505 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:39015
I20260808 18:38:51.696969 9706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:39015 every 8 connection(s)
I20260808 18:38:51.697906 9505 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:51.703809 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 9505
I20260808 18:38:51.703926 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:51.704222 4343 external_mini_cluster.cc:1428] Setting key 55d68f7f0737c3b58726eca0ff278894
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:51.711611 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.699751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:36405 (local address 127.4.61.254:37537)
0808 18:38:51.699903 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:51.699907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:51.700759 (+ 852us) server_negotiation.cc:407] Connection header received
0808 18:38:51.702096 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:51.702099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:51.702156 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:51.702236 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:51.703477 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.704046 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.705535 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.705809 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.705908 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.708371 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:51.708374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:51.708376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:51.708401 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:51.709553 (+ 1152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.710070 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.710073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.710074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.710161 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.710499 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.710502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.710503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.710700 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:51.710789 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:51.711371 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 18:38:51.711480 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 18:38:51.712427 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.700180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37537 (local address 127.4.61.195:36405)
0808 18:38:51.700611 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:51.700653 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:51.701889 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:51.702484 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:51.702491 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:51.702859 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:51.703342 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.703357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.704165 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.704169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.705419 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:51.705430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.705964 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.705967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:51.706118 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.706686 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:51.706704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:51.708192 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:51.709661 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.709666 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.709677 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.709965 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.710236 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:51.710239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:51.710240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:51.710416 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:51.710785 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:51.710790 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:51.711089 (+ 299us) client_negotiation.cc:769] Sending connection context
0808 18:38:51.711281 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 18:38:51.711542 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":113,"threads_started":1}
I20260808 18:38:51.713624 9707 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37537
I20260808 18:38:51.713869 9707 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:51.714414 9707 heartbeater.cc:511] Master 127.4.61.254:37537 requested a full tablet report, sending...
I20260808 18:38:51.715530 9012 ts_manager.cc:194] Registered new tserver with Master: 95b367e409a14d108867a6ec352d2736 (127.4.61.195:39015)
I20260808 18:38:51.716090 9012 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:36405
I20260808 18:38:51.718137 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214331, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:51.744009 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:51.735793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55624 (local address 127.4.61.254:37537)
0808 18:38:51.735950 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:51.735956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:51.736116 (+ 160us) server_negotiation.cc:407] Connection header received
0808 18:38:51.736275 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:51.736278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:51.736328 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:51.736400 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:51.737182 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.737727 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.738654 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:51.738885 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:51.738985 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:51.741378 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:51.741381 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:51.741384 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:51.741411 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:51.742666 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.743021 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.743023 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.743024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.743094 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:51.743297 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:51.743299 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:51.743300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:51.743514 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:51.743616 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:51.743792 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 18:38:51.743885 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 18:38:51.744429 9012 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55624
I20260808 18:38:51.745385 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 9114
I20260808 18:38:51.762555 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 9312
I20260808 18:38:51.775385 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 9505
I20260808 18:38:51.785390 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 8968
2026-08-08T18:38:51Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2296 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[9724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[9724](info): set up 2 sockets
Aug 08 18:38:51 dist-test-slave-fgb3 krb5kdc[9724](info): commencing operation
krb5kdc: starting...
W20260808 18:38:52.933629 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:53.051193 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44715
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:53.160925 9743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:53.161221 9743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:53.161262 9743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:53.165241 9743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:53.165303 9743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:53.165326 9743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:53.165341 9743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:53.165355 9743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:53.170928 9743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:53.171941 9743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:53.172910 9743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:53.181262 9748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.181236 9750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.181370 9743 server_base.cc:1034] running on GCE node
W20260808 18:38:53.181593 9754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.182140 9743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:53.183270 9743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:53.184444 9743 hybrid_clock.cc:648] HybridClock initialized: now 1786214333184420 us; error 35 us; skew 500 ppm
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:53.190912 9743 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:53.191856 9743 webserver.cc:460] Webserver started at http://127.4.61.254:42647/ using document root <none> and password file <none>
I20260808 18:38:53.192391 9743 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:53.192458 9743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:53.192641 9743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:53.194677 9743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "ef519ea8dd964da7bcf90054156a84e7"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "07c4d25eacd5666555950b879fbe8141"
server_key_iv: "32d1144d7acdba8dd62edd22970b1619"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.195235 9743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "ef519ea8dd964da7bcf90054156a84e7"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "07c4d25eacd5666555950b879fbe8141"
server_key_iv: "32d1144d7acdba8dd62edd22970b1619"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.198971 9743 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:38:53.201272 9762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.202494 9743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:53.202606 9743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "ef519ea8dd964da7bcf90054156a84e7"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "07c4d25eacd5666555950b879fbe8141"
server_key_iv: "32d1144d7acdba8dd62edd22970b1619"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.202700 9743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:53.233683 9743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:53.236541 9743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:53.236721 9743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:53.243445 9743 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:44715
I20260808 18:38:53.243474 9841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:44715 every 8 connection(s)
I20260808 18:38:53.244429 9743 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:53.247346 9843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:53.247764 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 9743
I20260808 18:38:53.247874 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:53.248154 4343 external_mini_cluster.cc:1428] Setting key 2deef87486ff4c4f7fbf21adb594ab6b
I20260808 18:38:53.253549 9843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7: Bootstrap starting.
I20260808 18:38:53.256246 9843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:53.257097 9843 log.cc:824] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:53.259227 9843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7: No bootstrap required, opened a new log
I20260808 18:38:53.262339 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.249602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57722 (local address 127.4.61.254:44715)
0808 18:38:53.249990 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:53.250006 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:53.250045 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:38:53.250735 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:53.250754 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:53.251096 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:53.251373 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:53.252308 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.253334 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.254478 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.254960 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.255076 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.257713 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:53.257720 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:53.257740 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:53.257771 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:53.259465 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.259985 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.259991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.259996 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.260120 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.260421 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.260423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.260425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.260824 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:53.260966 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:53.261256 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 18:38:53.261528 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":101,"threads_started":1}
I20260808 18:38:53.263213 9843 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } }
I20260808 18:38:53.263439 9843 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:53.263496 9843 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef519ea8dd964da7bcf90054156a84e7, State: Initialized, Role: FOLLOWER
I20260808 18:38:53.263908 9843 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } }
I20260808 18:38:53.264040 9843 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:53.264104 9843 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:53.264202 9843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:53.265086 9843 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } }
I20260808 18:38:53.265405 9843 leader_election.cc:302] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef519ea8dd964da7bcf90054156a84e7; no voters:
I20260808 18:38:53.265717 9843 leader_election.cc:288] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:53.265827 9850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:53.266041 9850 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [term 1 LEADER]: Becoming Leader. State: Replica: ef519ea8dd964da7bcf90054156a84e7, State: Running, Role: LEADER
I20260808 18:38:53.266386 9850 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } }
I20260808 18:38:53.266916 9843 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:53.268009 9854 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef519ea8dd964da7bcf90054156a84e7. Latest consensus state: current_term: 1 leader_uuid: "ef519ea8dd964da7bcf90054156a84e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } } }
I20260808 18:38:53.268139 9854 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:53.268394 9851 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef519ea8dd964da7bcf90054156a84e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef519ea8dd964da7bcf90054156a84e7" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44715 } } }
I20260808 18:38:53.268579 9864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:53.268937 9851 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:53.271494 9864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:53.276357 9864 catalog_manager.cc:1347] Generated new cluster ID: a6ac42e5a55b416fae87dfe8398e2c9c
I20260808 18:38:53.276420 9864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:53.304296 9864 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:53.305292 9864 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:53.317051 9864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef519ea8dd964da7bcf90054156a84e7: Generated new TSK 0
I20260808 18:38:53.317822 9864 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:53.347453 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:53.459563 9885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:53.459849 9885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:53.459910 9885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:53.464062 9885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:53.464134 9885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:53.464221 9885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:53.469725 9885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:53.470893 9885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:53.471968 9885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:53.481586 9897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.481652 9894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.481593 9895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.481846 9885 server_base.cc:1034] running on GCE node
I20260808 18:38:53.482260 9885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:53.482928 9885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:53.484103 9885 hybrid_clock.cc:648] HybridClock initialized: now 1786214333484073 us; error 39 us; skew 500 ppm
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:53.486797 9885 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:53.487689 9885 webserver.cc:460] Webserver started at http://127.4.61.193:46821/ using document root <none> and password file <none>
I20260808 18:38:53.488258 9885 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:53.488323 9885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:53.488511 9885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:53.490527 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "8a663abfae3d442fa76a85b8457df734"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "cc608699693b3c21407d1b5a91adc07b"
server_key_iv: "ad0ea5564a90b39f6f090cdbecbba4b8"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.491082 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "8a663abfae3d442fa76a85b8457df734"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "cc608699693b3c21407d1b5a91adc07b"
server_key_iv: "ad0ea5564a90b39f6f090cdbecbba4b8"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.494743 9885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:38:53.497098 9904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.498275 9885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:53.498422 9885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "8a663abfae3d442fa76a85b8457df734"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "cc608699693b3c21407d1b5a91adc07b"
server_key_iv: "ad0ea5564a90b39f6f090cdbecbba4b8"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.498526 9885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:53.510156 9885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:53.512847 9885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:53.513013 9885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:53.513566 9885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:53.514456 9885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:53.514508 9885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.514549 9885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:53.514588 9885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.522971 9885 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:41713
I20260808 18:38:53.523001 10075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:41713 every 8 connection(s)
I20260808 18:38:53.523859 9885 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:53.524591 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 9885
I20260808 18:38:53.524710 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:53.525008 4343 external_mini_cluster.cc:1428] Setting key e64aacb34311160b6a573170bb87ea51
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:53.538548 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.525661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:46271 (local address 127.4.61.254:44715)
0808 18:38:53.525806 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:53.525809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:53.526680 (+ 871us) server_negotiation.cc:407] Connection header received
0808 18:38:53.528136 (+ 1456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:53.528139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:53.528197 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:53.528301 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:53.529719 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.530263 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.531877 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.532114 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.532209 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.535124 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:53.535128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:53.535130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:53.535156 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:53.536474 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.536959 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.536962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.536963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.537042 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.537403 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.537406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.537407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.537602 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:53.537684 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:53.538217 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 18:38:53.538372 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:38:53.539587 10082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.526043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44715 (local address 127.4.61.193:46271)
0808 18:38:53.526527 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:53.526570 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:53.527916 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:53.528456 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:53.528463 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:53.528849 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:53.529530 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.529550 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.530429 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.530433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.531747 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.531758 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.532414 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.532419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.532633 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.533247 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:53.533279 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:53.534950 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:53.536582 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.536589 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.536606 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.536863 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.537152 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.537155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.537157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.537313 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.537682 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:53.537687 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:53.537940 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 18:38:53.538121 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 18:38:53.538532 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":121,"threads_started":1}
I20260808 18:38:53.540995 10077 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44715
I20260808 18:38:53.541241 10077 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:53.541769 10077 heartbeater.cc:511] Master 127.4.61.254:44715 requested a full tablet report, sending...
I20260808 18:38:53.543444 9786 ts_manager.cc:194] Registered new tserver with Master: 8a663abfae3d442fa76a85b8457df734 (127.4.61.193:41713)
I20260808 18:38:53.544620 9786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:46271
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:53.557435 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:53.669020 10085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:53.669301 10085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:53.669361 10085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:53.673416 10085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:53.673480 10085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:53.673563 10085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:53.679071 10085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:53.680112 10085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:53.681137 10085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:53.690675 10094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.690687 10093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.690985 10085 server_base.cc:1034] running on GCE node
W20260808 18:38:53.690687 10096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.691390 10085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:53.692013 10085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:53.693163 10085 hybrid_clock.cc:648] HybridClock initialized: now 1786214333693138 us; error 34 us; skew 500 ppm
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:53.695844 10085 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:53.696671 10085 webserver.cc:460] Webserver started at http://127.4.61.194:43787/ using document root <none> and password file <none>
I20260808 18:38:53.697206 10085 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:53.697270 10085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:53.697461 10085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:53.699549 10085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "204c4eaa895f44998a8455af180bf7dd"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "59b7c5a7a1159e1ec9ac985f3ae3a19c"
server_key_iv: "ee9e415cb9a96f3aa9719d12e2081308"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.700089 10085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "204c4eaa895f44998a8455af180bf7dd"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "59b7c5a7a1159e1ec9ac985f3ae3a19c"
server_key_iv: "ee9e415cb9a96f3aa9719d12e2081308"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.703806 10085 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 18:38:53.706266 10105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.707536 10085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:53.707643 10085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "204c4eaa895f44998a8455af180bf7dd"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "59b7c5a7a1159e1ec9ac985f3ae3a19c"
server_key_iv: "ee9e415cb9a96f3aa9719d12e2081308"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.707734 10085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:53.719535 10085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:53.722469 10085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:53.722636 10085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:53.723205 10085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:53.724040 10085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:53.724087 10085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.724139 10085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:53.724167 10085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.732671 10085 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:41255
I20260808 18:38:53.732698 10269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:41255 every 8 connection(s)
I20260808 18:38:53.733556 10085 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:53.734506 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 10085
I20260808 18:38:53.734639 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:53.734982 4343 external_mini_cluster.cc:1428] Setting key 739def8d8b3fb434e386b27510c98bb6
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:53.747913 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.735635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:34847 (local address 127.4.61.254:44715)
0808 18:38:53.735776 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:53.735781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:53.736696 (+ 915us) server_negotiation.cc:407] Connection header received
0808 18:38:53.738111 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:53.738115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:53.738171 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:53.738251 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:53.739761 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.740507 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.741729 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.741974 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.742058 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.744562 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:53.744565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:53.744567 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:53.744593 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:53.745942 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.746497 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.746500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.746501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.746582 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.746873 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.746875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.746876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.747048 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:53.747121 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:53.747687 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 18:38:53.747788 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:38:53.748927 10273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.736053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44715 (local address 127.4.61.194:34847)
0808 18:38:53.736557 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:53.736602 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:53.737894 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:53.738561 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:53.738568 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:53.739018 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:53.739607 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.739628 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.740614 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.740616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.741595 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.741605 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.742153 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.742157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.742384 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.742953 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:53.742969 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:53.744402 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:53.746051 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.746058 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.746073 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.746400 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.746660 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.746663 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.746664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.746799 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.747117 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:53.747122 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:53.747385 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 18:38:53.747646 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 18:38:53.747914 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":138,"threads_started":1}
I20260808 18:38:53.750134 10270 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44715
I20260808 18:38:53.750438 10270 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:53.751035 10270 heartbeater.cc:511] Master 127.4.61.254:44715 requested a full tablet report, sending...
I20260808 18:38:53.752251 9786 ts_manager.cc:194] Registered new tserver with Master: 204c4eaa895f44998a8455af180bf7dd (127.4.61.194:41255)
I20260808 18:38:53.752884 9786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:34847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:53.764780 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:53.876178 10277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:53.876447 10277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:53.876506 10277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:53.880549 10277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:53.880609 10277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:53.880687 10277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:53.885812 10277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:53.886915 10277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:53.887995 10277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:53.897411 10288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.897378 10283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:53.897467 10286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:53.897506 10277 server_base.cc:1034] running on GCE node
I20260808 18:38:53.897976 10277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:53.898689 10277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:53.899876 10277 hybrid_clock.cc:648] HybridClock initialized: now 1786214333899843 us; error 46 us; skew 500 ppm
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:53.903225 10277 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:53.904254 10277 webserver.cc:460] Webserver started at http://127.4.61.195:42507/ using document root <none> and password file <none>
I20260808 18:38:53.904914 10277 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:53.904996 10277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:53.905234 10277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:53.907932 10277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "595f9ce16311467a9b6daee173cbd92c"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "6c04694bcf5d8cc269b529fc7de6162f"
server_key_iv: "2e2f9e6e8eaa6c82f6c90dac33fec3cd"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.908649 10277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "595f9ce16311467a9b6daee173cbd92c"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "6c04694bcf5d8cc269b529fc7de6162f"
server_key_iv: "2e2f9e6e8eaa6c82f6c90dac33fec3cd"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.912748 10277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260808 18:38:53.915127 10301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.916339 10277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:53.916445 10277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "595f9ce16311467a9b6daee173cbd92c"
format_stamp: "Formatted at 2026-08-08 18:38:53 on dist-test-slave-fgb3"
server_key: "6c04694bcf5d8cc269b529fc7de6162f"
server_key_iv: "2e2f9e6e8eaa6c82f6c90dac33fec3cd"
server_key_version: "encryptionkey@0"
I20260808 18:38:53.916554 10277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:53.937646 10277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:53.940635 10277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:53.940811 10277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:53.941412 10277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:53.942279 10277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:53.942359 10277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.942413 10277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:53.942444 10277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:53.950978 10277 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:33619
I20260808 18:38:53.951006 10479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:33619 every 8 connection(s)
I20260808 18:38:53.951855 10277 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:53.961874 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 10277
I20260808 18:38:53.961989 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:53.962359 4343 external_mini_cluster.cc:1428] Setting key 462e4361e577a6e8439f03d657cc3c05
I20260808 18:38:53.965131 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.953717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:34147 (local address 127.4.61.254:44715)
0808 18:38:53.953861 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:53.953865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:53.954660 (+ 795us) server_negotiation.cc:407] Connection header received
0808 18:38:53.956007 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:53.956010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:53.956068 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:53.956136 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:53.957274 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.957806 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.958977 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.959197 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.959287 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.961658 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:53.961661 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:53.961663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:53.961689 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:53.963173 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.963709 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.963713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.963714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.963803 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:53.964147 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:53.964149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:53.964150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:53.964372 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:53.964451 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:53.964925 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 18:38:53.965019 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 18:38:53.965909 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.954049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44715 (local address 127.4.61.195:34147)
0808 18:38:53.954521 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:53.954562 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:53.955798 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:53.956308 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:53.956317 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:53.956665 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:53.957135 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.957149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.957926 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.957928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.958862 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:53.958872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.959338 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.959342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:53.959510 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.960068 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:53.960084 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:53.961489 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:53.963292 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.963298 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.963314 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.963625 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.963885 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:53.963888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:53.963890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:53.964068 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:53.964475 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:53.964481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:53.964720 (+ 239us) client_negotiation.cc:769] Sending connection context
0808 18:38:53.964882 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 18:38:53.965129 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":133,"threads_started":1}
I20260808 18:38:53.966959 10481 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44715
I20260808 18:38:53.967175 10481 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:53.967649 10481 heartbeater.cc:511] Master 127.4.61.254:44715 requested a full tablet report, sending...
I20260808 18:38:53.968600 9786 ts_manager.cc:194] Registered new tserver with Master: 595f9ce16311467a9b6daee173cbd92c (127.4.61.195:33619)
I20260808 18:38:53.969116 9786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:34147
I20260808 18:38:53.975888 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 18:38:53 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:38:54.001103 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:53.992705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33360 (local address 127.4.61.193:41713)
0808 18:38:53.993021 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:53.993031 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:53.993054 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:38:53.993104 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:53.993110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:53.993288 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:53.993433 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:53.994022 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.994848 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.995620 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:53.995964 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:53.996038 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:53.998135 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:53.998144 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:53.998157 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:53.998181 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:53.999671 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:54.000005 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:54.000009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:54.000010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:54.000083 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:54.000270 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:54.000272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:54.000273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:54.000503 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:54.000650 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:54.000788 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 18:38:54.000913 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":125,"threads_started":1}
Aug 08 18:38:54 dist-test-slave-fgb3 krb5kdc[9724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:54.011389 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:54.003847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52212 (local address 127.4.61.254:44715)
0808 18:38:54.003988 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:54.003991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:54.004004 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:38:54.004080 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:54.004082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:54.004122 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:54.004187 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:54.004666 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:54.005150 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:54.005911 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:54.006157 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:54.006254 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:54.008320 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:54.008323 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:54.008325 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:54.008347 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:54.009791 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:54.010150 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:54.010153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:54.010155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:54.010256 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:54.010531 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:54.010534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:54.010536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:54.010763 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:54.010890 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:54.011111 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 18:38:54.011236 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 18:38:54.011772 9786 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52212
I20260808 18:38:54.012339 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 9885
I20260808 18:38:54.027988 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 10085
I20260808 18:38:54.039395 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 10277
I20260808 18:38:54.050459 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 9743
2026-08-08T18:38:54Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2260 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:54 dist-test-slave-fgb3 krb5kdc[10496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:54 dist-test-slave-fgb3 krb5kdc[10496](info): set up 2 sockets
Aug 08 18:38:54 dist-test-slave-fgb3 krb5kdc[10496](info): commencing operation
krb5kdc: starting...
W20260808 18:38:55.183028 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:38:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:38:55.306149 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45589
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:55.421164 10521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:55.421470 10521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:55.421532 10521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:55.425634 10521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:55.425707 10521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:55.425743 10521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:55.425765 10521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:55.425793 10521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:55.431238 10521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:55.432348 10521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:55.433387 10521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:55.441650 10534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:55.441573 10529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:55.441722 10530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:55.442020 10521 server_base.cc:1034] running on GCE node
I20260808 18:38:55.442653 10521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:55.443818 10521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:55.444993 10521 hybrid_clock.cc:648] HybridClock initialized: now 1786214335444966 us; error 37 us; skew 500 ppm
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:55.447850 10521 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:38:55.448531 10521 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:55.448592 10521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:55.448766 10521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:55.450820 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "a71337f3620a4af88c751dc0e72c838c"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "a4a41f988141314cc3b77edc3902cdba"
server_key_iv: "96338f4b0a987397b5ebc6005d6c3eb4"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.451344 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "a71337f3620a4af88c751dc0e72c838c"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "a4a41f988141314cc3b77edc3902cdba"
server_key_iv: "96338f4b0a987397b5ebc6005d6c3eb4"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.454962 10521 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:55.457453 10547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.458762 10521 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:55.458868 10521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "a71337f3620a4af88c751dc0e72c838c"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "a4a41f988141314cc3b77edc3902cdba"
server_key_iv: "96338f4b0a987397b5ebc6005d6c3eb4"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.458956 10521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:55.475925 10521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:55.479401 10521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:55.479575 10521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:55.486303 10521 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:45589
I20260808 18:38:55.486609 10635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:45589 every 8 connection(s)
I20260808 18:38:55.487046 10521 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:55.489867 10636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:55.492951 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 10521
I20260808 18:38:55.493100 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:55.493398 4343 external_mini_cluster.cc:1428] Setting key 8e8e35b2ab6b1b66e99d54f61328e790
I20260808 18:38:55.496304 10636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: Bootstrap starting.
I20260808 18:38:55.499071 10636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:55.499840 10636 log.cc:824] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:55.501653 10636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: No bootstrap required, opened a new log
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:55.504567 10636 raft_consensus.cc:348] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } }
I20260808 18:38:55.504791 10636 raft_consensus.cc:374] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:55.504850 10636 raft_consensus.cc:729] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71337f3620a4af88c751dc0e72c838c, State: Initialized, Role: FOLLOWER
I20260808 18:38:55.505264 10636 consensus_queue.cc:260] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } }
I20260808 18:38:55.505393 10636 raft_consensus.cc:388] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:55.505460 10636 raft_consensus.cc:482] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:55.505558 10636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:55.506435 10636 raft_consensus.cc:504] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } }
I20260808 18:38:55.506759 10636 leader_election.cc:302] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a71337f3620a4af88c751dc0e72c838c; no voters:
I20260808 18:38:55.507050 10636 leader_election.cc:288] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:55.507555 10643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:55.507779 10643 raft_consensus.cc:686] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [term 1 LEADER]: Becoming Leader. State: Replica: a71337f3620a4af88c751dc0e72c838c, State: Running, Role: LEADER
I20260808 18:38:55.508116 10643 consensus_queue.cc:237] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } }
I20260808 18:38:55.508329 10636 sys_catalog.cc:564] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:55.508494 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:55.494889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52674 (local address 127.4.61.254:45589)
0808 18:38:55.495308 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:55.495328 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:55.495373 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:38:55.496171 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:55.496196 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:55.496627 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:55.496990 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:55.497647 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.499177 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.500052 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.500534 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.500686 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:55.503054 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:55.503059 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:55.503072 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:55.503099 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:55.505239 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:55.505724 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:55.505729 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:55.505733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:55.505846 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:55.506116 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:55.506120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:55.506121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:55.506574 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:55.506780 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:55.507201 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 18:38:55.507521 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":106,"threads_started":1}
I20260808 18:38:55.509276 10643 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a71337f3620a4af88c751dc0e72c838c. Latest consensus state: current_term: 1 leader_uuid: "a71337f3620a4af88c751dc0e72c838c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } } }
I20260808 18:38:55.509469 10643 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:55.509704 10644 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a71337f3620a4af88c751dc0e72c838c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71337f3620a4af88c751dc0e72c838c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45589 } } }
I20260808 18:38:55.509850 10644 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:55.510800 10654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:55.513425 10654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:55.518734 10654 catalog_manager.cc:1347] Generated new cluster ID: b53c074d8d534141abc061f89565fbf5
I20260808 18:38:55.518805 10654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:55.542677 10654 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:55.544085 10654 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:55.561553 10654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: Generated new TSK 0
I20260808 18:38:55.562439 10654 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:38:55.593197 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:55.705624 10673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:55.705855 10673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:55.705910 10673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:55.710117 10673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:55.710170 10673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:55.710237 10673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:55.715476 10673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:55.716483 10673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:55.717499 10673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:55.726729 10684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:55.726824 10673 server_base.cc:1034] running on GCE node
W20260808 18:38:55.726729 10679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:55.726964 10680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:55.727383 10673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:55.727950 10673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:55.729110 10673 hybrid_clock.cc:648] HybridClock initialized: now 1786214335729098 us; error 26 us; skew 500 ppm
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:55.731979 10673 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:38:55.732686 10673 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:55.732751 10673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:55.732939 10673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:55.734961 10673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "aee6dbb60b104891953da0d918c903d5"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "72a6cafcb6e54de8d9230de12e2ae900"
server_key_iv: "e6af50e47148cb0626abb72d8cd7a708"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.735522 10673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "aee6dbb60b104891953da0d918c903d5"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "72a6cafcb6e54de8d9230de12e2ae900"
server_key_iv: "e6af50e47148cb0626abb72d8cd7a708"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.739074 10673 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:55.741415 10694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.742586 10673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:55.742692 10673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "aee6dbb60b104891953da0d918c903d5"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "72a6cafcb6e54de8d9230de12e2ae900"
server_key_iv: "e6af50e47148cb0626abb72d8cd7a708"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.742782 10673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:55.763322 10673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:55.766477 10673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:55.766657 10673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:55.767258 10673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:55.768105 10673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:55.768152 10673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.768208 10673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:55.768232 10673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.776610 10673 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:39117
I20260808 18:38:55.776654 10872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:39117 every 8 connection(s)
I20260808 18:38:55.777237 10673 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:55.780313 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 10673
I20260808 18:38:55.780440 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:55.780714 4343 external_mini_cluster.cc:1428] Setting key 588ce0d69ccf67c2f30927cb0400c32a
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:38:55.790367 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:55.778997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38651 (local address 127.4.61.254:45589)
0808 18:38:55.779137 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:55.779142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:55.779982 (+ 840us) server_negotiation.cc:407] Connection header received
0808 18:38:55.781260 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:55.781263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:55.781309 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:55.781381 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:55.782648 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.783369 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.784498 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.784724 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.784813 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:55.787152 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:55.787156 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:55.787159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:55.787185 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:55.788456 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:55.788926 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:55.788929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:55.788930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:55.789007 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:55.789310 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:55.789313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:55.789315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:55.789492 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:55.789577 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:55.790055 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 18:38:55.790175 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:38:55.791290 10877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:55.779387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45589 (local address 127.4.61.193:38651)
0808 18:38:55.779836 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:55.779881 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:55.781046 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:55.781553 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:55.781560 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:55.781974 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:55.782508 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:55.782524 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.783490 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.783493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:55.784361 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:55.784380 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.784860 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.784865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:55.785033 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:55.785553 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:55.785569 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:55.787000 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:55.788567 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:55.788572 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:55.788586 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:55.788829 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:55.789087 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:55.789091 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:55.789093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:55.789223 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:55.789592 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:55.789598 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:55.789832 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 18:38:55.790010 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 18:38:55.790341 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":105,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:38:55.792511 10874 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45589
I20260808 18:38:55.792739 10874 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:55.793164 10874 heartbeater.cc:511] Master 127.4.61.254:45589 requested a full tablet report, sending...
I20260808 18:38:55.794624 10572 ts_manager.cc:194] Registered new tserver with Master: aee6dbb60b104891953da0d918c903d5 (127.4.61.193:39117)
I20260808 18:38:55.795724 10572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:38651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:38:55.806617 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:55.920264 10882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:55.920526 10882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:55.920591 10882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:55.924883 10882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:55.924945 10882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:55.925025 10882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:55.930421 10882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:55.931533 10882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:55.932717 10882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:55.942199 10892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:55.942193 10891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:55.942478 10882 server_base.cc:1034] running on GCE node
W20260808 18:38:55.942195 10895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:55.942931 10882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:55.943560 10882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:55.944717 10882 hybrid_clock.cc:648] HybridClock initialized: now 1786214335944692 us; error 35 us; skew 500 ppm
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:55.947602 10882 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:38:55.948305 10882 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:55.948378 10882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:55.948549 10882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:55.950601 10882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "8e2ae7d013444d558dfff5592b24bc66"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "0eb6616566e7a652847b9eaf8ab6bcc1"
server_key_iv: "d12c3d6470d10ca82caa9c4babfd018a"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.951133 10882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "8e2ae7d013444d558dfff5592b24bc66"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "0eb6616566e7a652847b9eaf8ab6bcc1"
server_key_iv: "d12c3d6470d10ca82caa9c4babfd018a"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.954826 10882 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:55.957211 10903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.958469 10882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:55.958575 10882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "8e2ae7d013444d558dfff5592b24bc66"
format_stamp: "Formatted at 2026-08-08 18:38:55 on dist-test-slave-fgb3"
server_key: "0eb6616566e7a652847b9eaf8ab6bcc1"
server_key_iv: "d12c3d6470d10ca82caa9c4babfd018a"
server_key_version: "encryptionkey@0"
I20260808 18:38:55.958673 10882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:55.973896 10882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:55.977138 10882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:55.977312 10882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:55.977908 10882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:55.978783 10882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:55.978833 10882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.978875 10882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:55.978906 10882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:55.987496 10882 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:34555
I20260808 18:38:55.987541 11072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:34555 every 8 connection(s)
I20260808 18:38:55.988068 10882 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:55.993316 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 10882
I20260808 18:38:55.993446 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:55.993726 4343 external_mini_cluster.cc:1428] Setting key 249c4b4f4ccd8c78ae51b485a09c96eb
Aug 08 18:38:55 dist-test-slave-fgb3 krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214335, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:56.001782 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:55.989734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:33867 (local address 127.4.61.254:45589)
0808 18:38:55.989850 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:55.989854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:55.990707 (+ 853us) server_negotiation.cc:407] Connection header received
0808 18:38:55.991967 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:55.991971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:55.992031 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:55.992103 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:55.993271 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.993870 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.995419 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.995639 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.995727 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:55.998282 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:55.998285 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:55.998287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:55.998350 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:55.999568 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.000181 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.000184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.000185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.000258 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.000637 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.000640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.000642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.000849 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:56.000929 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.001554 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.001657 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:38:56.003014 11077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:55.990082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45589 (local address 127.4.61.194:33867)
0808 18:38:55.990563 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:55.990605 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:55.991741 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:55.992283 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:55.992290 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:55.992639 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:55.993118 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:55.993132 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.993998 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.994001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:55.995303 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:55.995315 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:55.995776 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:55.995780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:55.995966 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:55.996524 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:55.996540 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:55.998108 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:55.999689 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:55.999697 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:55.999714 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:56.000087 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:56.000341 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:56.000344 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:56.000346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:56.000532 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:56.000956 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:56.000962 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:56.001299 (+ 337us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.001531 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.001900 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:38:56.004139 11073 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45589
I20260808 18:38:56.004370 11073 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:56.004822 11073 heartbeater.cc:511] Master 127.4.61.254:45589 requested a full tablet report, sending...
I20260808 18:38:56.005817 10572 ts_manager.cc:194] Registered new tserver with Master: 8e2ae7d013444d558dfff5592b24bc66 (127.4.61.194:34555)
I20260808 18:38:56.006405 10572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:33867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:38:56.021276 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:38:56.133423 11080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:56.133666 11080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:56.133708 11080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:56.137586 11080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:56.137642 11080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:56.137699 11080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:56.143172 11080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:56.144147 11080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:56.145097 11080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:56.154374 11092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:56.154404 11090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:56.154374 11094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:56.154471 11080 server_base.cc:1034] running on GCE node
I20260808 18:38:56.155126 11080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:56.155733 11080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:56.156890 11080 hybrid_clock.cc:648] HybridClock initialized: now 1786214336156874 us; error 30 us; skew 500 ppm
Aug 08 18:38:56 dist-test-slave-fgb3 krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214336, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:38:56.159667 11080 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:38:56.160439 11080 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:56.160511 11080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:56.160703 11080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:56.162902 11080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "19dafcdd7e2543dea3171c15f3f21427"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "8dae0df0d63a0b199c46ad347dc4af6f"
server_key_iv: "c3d05e89826a8c9719f3e4745f545ac5"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.163470 11080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "19dafcdd7e2543dea3171c15f3f21427"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "8dae0df0d63a0b199c46ad347dc4af6f"
server_key_iv: "c3d05e89826a8c9719f3e4745f545ac5"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.167280 11080 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:38:56.169661 11103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.170938 11080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:56.171047 11080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "19dafcdd7e2543dea3171c15f3f21427"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "8dae0df0d63a0b199c46ad347dc4af6f"
server_key_iv: "c3d05e89826a8c9719f3e4745f545ac5"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.171145 11080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:56.198060 11080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:56.201396 11080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:56.201587 11080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:56.202205 11080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:56.203104 11080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:56.203169 11080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.203226 11080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:56.203253 11080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.212128 11080 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:39363
I20260808 18:38:56.212143 11269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:39363 every 8 connection(s)
I20260808 18:38:56.212739 11080 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:56.218264 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 11080
I20260808 18:38:56.218418 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:56.218712 4343 external_mini_cluster.cc:1428] Setting key a78427dafc102133b66c871e57ee8545
Aug 08 18:38:56 dist-test-slave-fgb3 krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214336, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:38:56.226647 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.214530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:53047 (local address 127.4.61.254:45589)
0808 18:38:56.214666 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.214674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.215540 (+ 866us) server_negotiation.cc:407] Connection header received
0808 18:38:56.216845 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.216849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.216910 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.216987 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:56.218297 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.218958 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.220377 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.220692 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.220798 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.223292 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:56.223296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:56.223299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:56.223327 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:56.224617 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.225080 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.225083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.225084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.225163 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.225509 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.225511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.225512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.225687 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:56.225759 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.226382 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.226515 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:38:56.227466 11275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.214920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45589 (local address 127.4.61.195:53047)
0808 18:38:56.215384 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.215428 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.216615 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.217179 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.217186 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.217571 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:56.218139 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.218156 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.219077 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.219080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.220249 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.220260 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.220855 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.220860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.221041 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.221615 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:38:56.221633 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:56.223135 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:56.224718 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:56.224723 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:56.224737 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:56.225000 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:56.225273 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:38:56.225276 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:38:56.225277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:38:56.225430 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:38:56.225813 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:56.225819 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:56.226081 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.226262 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.226608 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":107,"threads_started":1}
I20260808 18:38:56.228615 11271 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45589
I20260808 18:38:56.228839 11271 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:56.229280 11271 heartbeater.cc:511] Master 127.4.61.254:45589 requested a full tablet report, sending...
I20260808 18:38:56.230391 10572 ts_manager.cc:194] Registered new tserver with Master: 19dafcdd7e2543dea3171c15f3f21427 (127.4.61.195:39363)
I20260808 18:38:56.230984 10572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:53047
I20260808 18:38:56.232692 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:38:56.241786 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.234717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52676 (local address 127.4.61.254:45589)
0808 18:38:56.234830 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.234835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.235044 (+ 209us) server_negotiation.cc:407] Connection header received
0808 18:38:56.235174 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.235177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.235223 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.235283 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:56.235995 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.236520 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.237348 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.237574 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.237668 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.239014 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:56.239019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:56.239021 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:38:56.239049 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:56.240175 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.240571 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.240576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.240578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.240660 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:38:56.240925 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:38:56.240928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:38:56.240930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:38:56.241157 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:56.241280 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.241516 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.241630 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 18:38:56.244554 10572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:56.247696 10572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:56.261842 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.256527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54534 (local address 127.4.61.195:39363)
0808 18:38:56.257465 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.257474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.257490 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:38:56.257547 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.257551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.257716 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.258119 (+ 403us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:56.258275 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259198 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.260522 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.261108 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.261220 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.261381 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.261551 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.261656 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":158,"threads_started":1}
I20260808 18:38:56.261982 11293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.255770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:39363 (local address 127.0.0.1:54534)
0808 18:38:56.256997 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.257050 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.257190 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.257861 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.257864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.257879 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:56.257979 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.257985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259338 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.259341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.260391 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.260402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.261218 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.261222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.261349 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.261395 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.261512 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.261644 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":12,"spinlock_wait_cycles":2176,"thread_start_us":92,"threads_started":1}
I20260808 18:38:56.263221 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.255892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.4.61.193:39117)
0808 18:38:56.256642 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.256650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.257140 (+ 490us) server_negotiation.cc:407] Connection header received
0808 18:38:56.257387 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.257392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.257569 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.257726 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:56.258034 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259277 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.261143 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.262143 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.262253 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.262570 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.262968 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.263076 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":105,"threads_started":1}
I20260808 18:38:56.263525 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.256549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46308 (local address 127.4.61.194:34555)
0808 18:38:56.256850 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.256861 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.257143 (+ 282us) server_negotiation.cc:407] Connection header received
0808 18:38:56.257347 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.257353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.257570 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.257727 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:56.258232 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259375 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.261116 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.261970 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.262070 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.262548 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.263187 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.263289 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":107,"threads_started":1}
I20260808 18:38:56.263671 11298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.255723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:39117 (local address 127.0.0.1:48904)
0808 18:38:56.256997 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.257049 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.257201 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.257730 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.257737 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.257759 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:56.257906 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.257914 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259434 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.259437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.260976 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.260988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.262632 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.262636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.262790 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.262819 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.263417 (+ 598us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.263539 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":157,"thread_start_us":89,"threads_started":1}
I20260808 18:38:56.263942 11295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.256042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:34555 (local address 127.0.0.1:46308)
0808 18:38:56.257017 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.257050 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.257190 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.258033 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.258036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.258053 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:56.258124 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.258129 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.259501 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.259504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.260976 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.260988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.262615 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.262619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.262772 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.262810 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.262953 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.263036 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":183,"spinlock_wait_cycles":5376,"thread_start_us":81,"threads_started":1}
I20260808 18:38:56.265478 11173 tablet_service.cc:1467] Processing CreateTablet for tablet 4c960264eebd4293a46955e737e90dac (DEFAULT_TABLE table=test-table [id=62da65242433463e9222face993436af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:56.266619 11173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c960264eebd4293a46955e737e90dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:56.266494 10769 tablet_service.cc:1467] Processing CreateTablet for tablet 4c960264eebd4293a46955e737e90dac (DEFAULT_TABLE table=test-table [id=62da65242433463e9222face993436af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:56.266498 10969 tablet_service.cc:1467] Processing CreateTablet for tablet 4c960264eebd4293a46955e737e90dac (DEFAULT_TABLE table=test-table [id=62da65242433463e9222face993436af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:56.267563 10969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c960264eebd4293a46955e737e90dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:56.267565 10769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c960264eebd4293a46955e737e90dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:56.273188 11301 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Bootstrap starting.
I20260808 18:38:56.275173 11303 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: Bootstrap starting.
I20260808 18:38:56.275321 11304 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Bootstrap starting.
I20260808 18:38:56.275843 11301 tablet_bootstrap.cc:654] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:56.277226 11301 log.cc:824] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:56.277594 11304 tablet_bootstrap.cc:654] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:56.278885 11304 log.cc:824] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:56.279929 11303 tablet_bootstrap.cc:654] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:56.280671 11304 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: No bootstrap required, opened a new log
I20260808 18:38:56.280778 11301 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: No bootstrap required, opened a new log
I20260808 18:38:56.280884 11304 ts_tablet_manager.cc:1397] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:38:56.280987 11301 ts_tablet_manager.cc:1397] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 18:38:56.281159 11303 log.cc:824] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:56.283213 11303 tablet_bootstrap.cc:492] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: No bootstrap required, opened a new log
I20260808 18:38:56.283422 11303 ts_tablet_manager.cc:1397] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 18:38:56.284228 11304 raft_consensus.cc:348] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.284623 11304 raft_consensus.cc:374] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:56.284730 11304 raft_consensus.cc:729] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2ae7d013444d558dfff5592b24bc66, State: Initialized, Role: FOLLOWER
I20260808 18:38:56.284710 11301 raft_consensus.cc:348] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.284993 11301 raft_consensus.cc:374] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:56.285091 11301 raft_consensus.cc:729] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19dafcdd7e2543dea3171c15f3f21427, State: Initialized, Role: FOLLOWER
I20260808 18:38:56.285322 11304 consensus_queue.cc:260] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.285529 11301 consensus_queue.cc:260] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.285988 11073 heartbeater.cc:503] Master 127.4.61.254:45589 was elected leader, sending a full tablet report...
I20260808 18:38:56.286620 11301 ts_tablet_manager.cc:1428] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 18:38:56.286692 11271 heartbeater.cc:503] Master 127.4.61.254:45589 was elected leader, sending a full tablet report...
I20260808 18:38:56.287122 11303 raft_consensus.cc:348] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.287372 11304 ts_tablet_manager.cc:1428] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:38:56.287426 11303 raft_consensus.cc:374] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:56.287532 11303 raft_consensus.cc:729] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee6dbb60b104891953da0d918c903d5, State: Initialized, Role: FOLLOWER
I20260808 18:38:56.288018 11303 consensus_queue.cc:260] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.288668 10874 heartbeater.cc:503] Master 127.4.61.254:45589 was elected leader, sending a full tablet report...
I20260808 18:38:56.288884 11303 ts_tablet_manager.cc:1428] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:38:56.318813 11313 raft_consensus.cc:482] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:56.319046 11313 raft_consensus.cc:504] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.320230 11313 leader_election.cc:288] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee6dbb60b104891953da0d918c903d5 (127.4.61.193:39117), 8e2ae7d013444d558dfff5592b24bc66 (127.4.61.194:34555)
I20260808 18:38:56.324045 11275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.320420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:39117 (local address 127.4.61.195:33989)
0808 18:38:56.320635 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.320651 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.320744 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.321050 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.321053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.321073 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:56.321203 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.321209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.322067 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.322071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.322942 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.322952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.323609 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.323713 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.323737 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.323826 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.323903 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260808 18:38:56.324044 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.320578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:33989 (local address 127.4.61.193:39117)
0808 18:38:56.320722 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.320727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.320745 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:38:56.320873 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.320877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.320944 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.321032 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:56.321347 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.321955 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323067 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.323493 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323589 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.323645 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.323836 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.323919 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 18:38:56.324087 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.320638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:40565 (local address 127.4.61.194:34555)
0808 18:38:56.320775 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.320779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.321034 (+ 255us) server_negotiation.cc:407] Connection header received
0808 18:38:56.321146 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.321148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.321198 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.321280 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:38:56.321589 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.322074 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323134 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.323552 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323665 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.323716 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.323911 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.323985 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 18:38:56.324419 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.320471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:34555 (local address 127.4.61.195:40565)
0808 18:38:56.320944 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.320958 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.321048 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.321343 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.321346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.321367 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:38:56.321483 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.321489 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.322177 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.322180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.323005 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:56.323017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.323678 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.323682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:56.323763 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.323782 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.324204 (+ 422us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.324294 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":107,"threads_started":1}
I20260808 18:38:56.324859 10799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c960264eebd4293a46955e737e90dac" candidate_uuid: "19dafcdd7e2543dea3171c15f3f21427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee6dbb60b104891953da0d918c903d5" is_pre_election: true
I20260808 18:38:56.325031 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c960264eebd4293a46955e737e90dac" candidate_uuid: "19dafcdd7e2543dea3171c15f3f21427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2ae7d013444d558dfff5592b24bc66" is_pre_election: true
I20260808 18:38:56.325203 10799 raft_consensus.cc:2454] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19dafcdd7e2543dea3171c15f3f21427 in term 0.
I20260808 18:38:56.325337 11002 raft_consensus.cc:2454] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19dafcdd7e2543dea3171c15f3f21427 in term 0.
I20260808 18:38:56.325778 11108 leader_election.cc:302] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19dafcdd7e2543dea3171c15f3f21427, 8e2ae7d013444d558dfff5592b24bc66, aee6dbb60b104891953da0d918c903d5; no voters:
I20260808 18:38:56.326054 11313 raft_consensus.cc:2781] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:56.326148 11313 raft_consensus.cc:482] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:56.326198 11313 raft_consensus.cc:3037] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:56.327276 11313 raft_consensus.cc:504] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.327617 11313 leader_election.cc:288] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [CANDIDATE]: Term 1 election: Requested vote from peers aee6dbb60b104891953da0d918c903d5 (127.4.61.193:39117), 8e2ae7d013444d558dfff5592b24bc66 (127.4.61.194:34555)
I20260808 18:38:56.328001 10799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c960264eebd4293a46955e737e90dac" candidate_uuid: "19dafcdd7e2543dea3171c15f3f21427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee6dbb60b104891953da0d918c903d5"
I20260808 18:38:56.328001 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c960264eebd4293a46955e737e90dac" candidate_uuid: "19dafcdd7e2543dea3171c15f3f21427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2ae7d013444d558dfff5592b24bc66"
I20260808 18:38:56.328133 10799 raft_consensus.cc:3037] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:56.328133 11002 raft_consensus.cc:3037] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:56.329427 11002 raft_consensus.cc:2454] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19dafcdd7e2543dea3171c15f3f21427 in term 1.
I20260808 18:38:56.329427 10799 raft_consensus.cc:2454] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19dafcdd7e2543dea3171c15f3f21427 in term 1.
I20260808 18:38:56.329732 11106 leader_election.cc:302] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19dafcdd7e2543dea3171c15f3f21427, 8e2ae7d013444d558dfff5592b24bc66; no voters:
I20260808 18:38:56.329886 11313 raft_consensus.cc:2781] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:56.330142 11313 raft_consensus.cc:686] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 1 LEADER]: Becoming Leader. State: Replica: 19dafcdd7e2543dea3171c15f3f21427, State: Running, Role: LEADER
I20260808 18:38:56.330523 11313 consensus_queue.cc:237] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } }
I20260808 18:38:56.333953 10569 catalog_manager.cc:5495] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19dafcdd7e2543dea3171c15f3f21427 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "19dafcdd7e2543dea3171c15f3f21427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19dafcdd7e2543dea3171c15f3f21427" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:56.359140 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.355642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.4.61.195:39363)
0808 18:38:56.355775 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.355780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.355794 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:38:56.355923 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.355925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.355982 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.356072 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:38:56.356326 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.356820 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.357658 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:56.357868 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:56.357971 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:56.358340 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:38:56.358752 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:38:56.358857 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.358929 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.358988 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:38:56.365162 11002 raft_consensus.cc:1261] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 1 FOLLOWER]: Refusing update from remote peer 19dafcdd7e2543dea3171c15f3f21427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:56.365162 10799 raft_consensus.cc:1261] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5 [term 1 FOLLOWER]: Refusing update from remote peer 19dafcdd7e2543dea3171c15f3f21427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:56.365958 11313 consensus_queue.cc:1035] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2ae7d013444d558dfff5592b24bc66" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:56.366174 11319 consensus_queue.cc:1035] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee6dbb60b104891953da0d918c903d5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:56.382105 10571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:56.382272 10571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:56.384506 10571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a71337f3620a4af88c751dc0e72c838c: Sending DeleteTablet for 3 replicas of tablet 4c960264eebd4293a46955e737e90dac
I20260808 18:38:56.385210 10769 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c960264eebd4293a46955e737e90dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:56 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:48904
I20260808 18:38:56.385308 11173 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c960264eebd4293a46955e737e90dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:56 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:54534
I20260808 18:38:56.385342 10969 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c960264eebd4293a46955e737e90dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:56 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:46308
I20260808 18:38:56.385746 11338 tablet_replica.cc:330] T 4c960264eebd4293a46955e737e90dac P aee6dbb60b104891953da0d918c903d5: stopping tablet replica
I20260808 18:38:56.385833 11340 tablet_replica.cc:330] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: stopping tablet replica
I20260808 18:38:56.385970 11339 tablet_replica.cc:330] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: stopping tablet replica
I20260808 18:38:56.386183 11340 raft_consensus.cc:2229] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:56.386361 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 10673
I20260808 18:38:56.420347 11340 raft_consensus.cc:2258] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:56.421131 11339 raft_consensus.cc:2229] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:56.421593 11339 raft_consensus.cc:2258] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:56.422636 11340 ts_tablet_manager.cc:1905] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:56.423168 11339 ts_tablet_manager.cc:1905] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:56.425581 11340 ts_tablet_manager.cc:1918] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:56.425788 11340 log.cc:1196] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/4c960264eebd4293a46955e737e90dac
I20260808 18:38:56.425871 11339 ts_tablet_manager.cc:1918] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:56.426038 11339 log.cc:1196] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/4c960264eebd4293a46955e737e90dac
I20260808 18:38:56.426258 11340 ts_tablet_manager.cc:1939] T 4c960264eebd4293a46955e737e90dac P 19dafcdd7e2543dea3171c15f3f21427: Deleting consensus metadata
I20260808 18:38:56.426463 11339 ts_tablet_manager.cc:1939] T 4c960264eebd4293a46955e737e90dac P 8e2ae7d013444d558dfff5592b24bc66: Deleting consensus metadata
I20260808 18:38:56.427671 10549 catalog_manager.cc:4841] TS 8e2ae7d013444d558dfff5592b24bc66 (127.4.61.194:34555): tablet 4c960264eebd4293a46955e737e90dac (table test-table [id=62da65242433463e9222face993436af]) successfully deleted
I20260808 18:38:56.427671 10550 catalog_manager.cc:4841] TS 19dafcdd7e2543dea3171c15f3f21427 (127.4.61.195:39363): tablet 4c960264eebd4293a46955e737e90dac (table test-table [id=62da65242433463e9222face993436af]) successfully deleted
W20260808 18:38:56.428555 10551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:39117 (error 108)
I20260808 18:38:56.428696 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 10882
I20260808 18:38:56.432442 11295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.429424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:39117 (local address 127.0.0.1:48912)
0808 18:38:56.432271 (+ 2847us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.432349 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:39117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2749}
W20260808 18:38:56.433476 10551 catalog_manager.cc:4584] TS aee6dbb60b104891953da0d918c903d5 (127.4.61.193:39117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c960264eebd4293a46955e737e90dac: Network error: Client connection negotiation failed: client connection to 127.4.61.193:39117: connect: Connection refused (error 111)
I20260808 18:38:56.438764 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 11080
I20260808 18:38:56.454934 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 10521
2026-08-08T18:38:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2411 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T18:38:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:56Z Disabled control of system clock
I20260808 18:38:56.492872 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45423
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 18:38:56.603185 11346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:56.603464 11346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:56.603505 11346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:56.607566 11346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:56.607630 11346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:56.607645 11346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:56.607662 11346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:56.607679 11346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:38:56.612527 11346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45423
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:56.613597 11346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:56.615064 11346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:56.623296 11355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:56.623325 11359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:56.623674 11346 server_base.cc:1034] running on GCE node
W20260808 18:38:56.623296 11357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:56.624238 11346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:56.625355 11346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:56.626516 11346 hybrid_clock.cc:648] HybridClock initialized: now 1786214336626498 us; error 33 us; skew 500 ppm
I20260808 18:38:56.628374 11346 webserver.cc:460] Webserver started at http://127.4.61.254:42815/ using document root <none> and password file <none>
I20260808 18:38:56.628952 11346 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:56.629022 11346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:56.629218 11346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:56.631353 11346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "81a4800fde674693bbf2e5621d147d31"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "f2bbe9ec932202fff9db534f894765b4"
server_key_iv: "ae708bc9d321ff36ff0fd7bfe927bcbb"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.631916 11346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "81a4800fde674693bbf2e5621d147d31"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "f2bbe9ec932202fff9db534f894765b4"
server_key_iv: "ae708bc9d321ff36ff0fd7bfe927bcbb"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.635592 11346 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:56.638134 11371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.639428 11346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:56.639554 11346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "81a4800fde674693bbf2e5621d147d31"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "f2bbe9ec932202fff9db534f894765b4"
server_key_iv: "ae708bc9d321ff36ff0fd7bfe927bcbb"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.639660 11346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:56.644268 11346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:56.644877 11346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:56.645040 11346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:56.652027 11346 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:45423
I20260808 18:38:56.652033 11453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:45423 every 8 connection(s)
I20260808 18:38:56.652992 11346 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:56.656322 11454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:56.658556 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 11346
I20260808 18:38:56.658675 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:56.658949 4343 external_mini_cluster.cc:1428] Setting key d891c3c6b90828d5d3f17965a36d4f9e
I20260808 18:38:56.663058 11454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: Bootstrap starting.
I20260808 18:38:56.664981 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.660477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.4.61.254:45423)
0808 18:38:56.661127 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.661143 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.661252 (+ 109us) server_negotiation.cc:407] Connection header received
0808 18:38:56.661967 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.661986 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.662422 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.662747 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:56.663667 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:56.663672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:56.663685 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:56.663696 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:56.663753 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:56.663770 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:56.663885 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.663989 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.664226 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":122,"threads_started":1}
I20260808 18:38:56.665728 11454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:56.666594 11454 log.cc:824] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:56.668634 11454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: No bootstrap required, opened a new log
I20260808 18:38:56.672226 11454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } }
I20260808 18:38:56.672470 11454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:56.672534 11454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a4800fde674693bbf2e5621d147d31, State: Initialized, Role: FOLLOWER
I20260808 18:38:56.672958 11454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } }
I20260808 18:38:56.673099 11454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:56.673171 11454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:56.673280 11454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:56.674226 11454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } }
I20260808 18:38:56.674592 11454 leader_election.cc:302] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81a4800fde674693bbf2e5621d147d31; no voters:
I20260808 18:38:56.674939 11454 leader_election.cc:288] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:56.675024 11460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:56.675220 11460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [term 1 LEADER]: Becoming Leader. State: Replica: 81a4800fde674693bbf2e5621d147d31, State: Running, Role: LEADER
I20260808 18:38:56.675536 11460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } }
I20260808 18:38:56.676298 11454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:56.677405 11462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81a4800fde674693bbf2e5621d147d31. Latest consensus state: current_term: 1 leader_uuid: "81a4800fde674693bbf2e5621d147d31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } } }
I20260808 18:38:56.677542 11462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:56.677767 11463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81a4800fde674693bbf2e5621d147d31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a4800fde674693bbf2e5621d147d31" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45423 } } }
I20260808 18:38:56.677860 11463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:56.678694 11471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:56.681758 11471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:56.687646 11471 catalog_manager.cc:1347] Generated new cluster ID: ab3d0df78bdf4e2db5fe90157e108f2b
I20260808 18:38:56.687731 11471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:56.718068 11471 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:56.718526 11471 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:56.728662 11471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: Generated new TSK 0
I20260808 18:38:56.729480 11471 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:38:56.741101 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--builtin_ntp_servers=127.4.61.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 18:38:56.888897 11491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:56.889153 11491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:56.889191 11491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:56.893093 11491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:56.893143 11491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:56.893196 11491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:38:56.897818 11491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:56.898911 11491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:56.900290 11491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:56.909688 11497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:56.909660 11500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:56.909687 11498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:56.910056 11491 server_base.cc:1034] running on GCE node
I20260808 18:38:56.910473 11491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:56.911110 11491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:56.912300 11491 hybrid_clock.cc:648] HybridClock initialized: now 1786214336912278 us; error 33 us; skew 500 ppm
I20260808 18:38:56.914224 11491 webserver.cc:460] Webserver started at http://127.4.61.193:34235/ using document root <none> and password file <none>
I20260808 18:38:56.914860 11491 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:56.914929 11491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:56.915128 11491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:56.917550 11491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "eca12d144a594683bcce2edbf79c3556"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "9bd00447c2a6459dc794bc785f1a327d"
server_key_iv: "7afe97534c90cd4ba4b3ef50d0224b7f"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.918294 11491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "eca12d144a594683bcce2edbf79c3556"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "9bd00447c2a6459dc794bc785f1a327d"
server_key_iv: "7afe97534c90cd4ba4b3ef50d0224b7f"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.922217 11491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 18:38:56.924678 11507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.925963 11491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:56.926084 11491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "eca12d144a594683bcce2edbf79c3556"
format_stamp: "Formatted at 2026-08-08 18:38:56 on dist-test-slave-fgb3"
server_key: "9bd00447c2a6459dc794bc785f1a327d"
server_key_iv: "7afe97534c90cd4ba4b3ef50d0224b7f"
server_key_version: "encryptionkey@0"
I20260808 18:38:56.926185 11491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:56.931150 11491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:56.931787 11491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:56.931948 11491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:56.932500 11491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:56.933427 11491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:56.933475 11491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.933527 11491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:56.933552 11491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:56.942013 11491 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:42643
I20260808 18:38:56.942061 11683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:42643 every 8 connection(s)
I20260808 18:38:56.943009 11491 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:38:56.949342 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.944967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:50881 (local address 127.4.61.254:45423)
0808 18:38:56.945102 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:56.945106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:56.946213 (+ 1107us) server_negotiation.cc:407] Connection header received
0808 18:38:56.947666 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:56.947669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:56.947724 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:56.947804 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:56.948895 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:56.948899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:56.948902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:56.948914 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:56.948933 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:56.948941 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:56.949019 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:56.949143 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 18:38:56.949190 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:38:56.949676 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 11491
I20260808 18:38:56.949800 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:38:56.950069 4343 external_mini_cluster.cc:1428] Setting key b1fa2e6de88c6fb7edbe965275301857
I20260808 18:38:56.950235 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:56.945372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45423 (local address 127.4.61.193:50881)
0808 18:38:56.946071 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:56.946111 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:56.947465 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:56.947986 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:56.947993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:56.948081 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:56.948613 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:56.948615 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:56.948655 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:56.948723 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:56.949009 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:56.949018 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:56.949024 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:56.949182 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 18:38:56.949420 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":129,"threads_started":1}
I20260808 18:38:56.951489 11684 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45423
I20260808 18:38:56.951719 11684 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:56.952044 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--builtin_ntp_servers=127.4.61.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 18:38:56.952128 11684 heartbeater.cc:511] Master 127.4.61.254:45423 requested a full tablet report, sending...
I20260808 18:38:56.953644 11398 ts_manager.cc:194] Registered new tserver with Master: eca12d144a594683bcce2edbf79c3556 (127.4.61.193:42643)
W20260808 18:38:57.070127 11688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:57.070429 11688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:57.070482 11688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:57.074476 11688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:57.074534 11688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:57.074600 11688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:38:57.079456 11688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:57.080658 11688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:57.082157 11688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:57.092103 11701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:57.092149 11688 server_base.cc:1034] running on GCE node
W20260808 18:38:57.092096 11700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:57.092096 11704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:57.093152 11688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:57.093731 11688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:57.094907 11688 hybrid_clock.cc:648] HybridClock initialized: now 1786214337094885 us; error 36 us; skew 500 ppm
I20260808 18:38:57.096644 11688 webserver.cc:460] Webserver started at http://127.4.61.194:33755/ using document root <none> and password file <none>
I20260808 18:38:57.097205 11688 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:57.097301 11688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:57.097508 11688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:57.099603 11688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "9b0c72318b3b4825aba8ec8c3e17a207"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "c029fb3fdd78f98c6a9b8e227dab241f"
server_key_iv: "1356b995c51870bcf0caf62d41d11a06"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.100144 11688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "9b0c72318b3b4825aba8ec8c3e17a207"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "c029fb3fdd78f98c6a9b8e227dab241f"
server_key_iv: "1356b995c51870bcf0caf62d41d11a06"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.103737 11688 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:57.105962 11714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.107141 11688 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:57.107239 11688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "9b0c72318b3b4825aba8ec8c3e17a207"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "c029fb3fdd78f98c6a9b8e227dab241f"
server_key_iv: "1356b995c51870bcf0caf62d41d11a06"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.107337 11688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:57.111711 11688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:57.112283 11688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:57.112450 11688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:57.112974 11688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:57.113880 11688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:57.113926 11688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.113968 11688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:57.113997 11688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.122126 11688 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:41873
I20260808 18:38:57.122181 11882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:41873 every 8 connection(s)
I20260808 18:38:57.123018 11688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:38:57.128890 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.124745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:52383 (local address 127.4.61.254:45423)
0808 18:38:57.124882 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.124886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.125958 (+ 1072us) server_negotiation.cc:407] Connection header received
0808 18:38:57.127314 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.127318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.127364 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.127441 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.128450 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.128454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.128457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.128469 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.128488 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.128495 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.128582 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.128697 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.128742 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:38:57.129199 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 11688
I20260808 18:38:57.129317 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:38:57.129608 4343 external_mini_cluster.cc:1428] Setting key ea03d115f752d3a640b1a40857810e35
I20260808 18:38:57.129874 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.125117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45423 (local address 127.4.61.194:52383)
0808 18:38:57.125837 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.125878 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.127106 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.127613 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.127620 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.127704 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.128179 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.128181 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.128218 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.128309 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.128562 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.128570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.128576 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.128733 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.128961 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":110,"threads_started":1}
I20260808 18:38:57.131011 11886 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45423
I20260808 18:38:57.131254 11886 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:57.131619 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--builtin_ntp_servers=127.4.61.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 18:38:57.131646 11886 heartbeater.cc:511] Master 127.4.61.254:45423 requested a full tablet report, sending...
I20260808 18:38:57.132658 11398 ts_manager.cc:194] Registered new tserver with Master: 9b0c72318b3b4825aba8ec8c3e17a207 (127.4.61.194:41873)
W20260808 18:38:57.250075 11889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:57.250373 11889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:57.250448 11889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:57.254437 11889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:57.254487 11889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:57.254566 11889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:38:57.259358 11889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:57.260434 11889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:57.261912 11889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:57.272011 11899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:57.272099 11889 server_base.cc:1034] running on GCE node
W20260808 18:38:57.271986 11903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:57.272722 11900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:57.273149 11889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:57.273770 11889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:57.274947 11889 hybrid_clock.cc:648] HybridClock initialized: now 1786214337274925 us; error 34 us; skew 500 ppm
I20260808 18:38:57.276906 11889 webserver.cc:460] Webserver started at http://127.4.61.195:41101/ using document root <none> and password file <none>
I20260808 18:38:57.277530 11889 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:57.277596 11889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:57.277828 11889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:57.280038 11889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "0666790c021e4d0f96e96882a8ee3c90"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "62f70b60504dbba72497e395aae0cc55"
server_key_iv: "a83b2ea9b9c45b061ac54d6a7fe6dfee"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.280607 11889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "0666790c021e4d0f96e96882a8ee3c90"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "62f70b60504dbba72497e395aae0cc55"
server_key_iv: "a83b2ea9b9c45b061ac54d6a7fe6dfee"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.284499 11889 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:38:57.286944 11909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.288215 11889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:57.288334 11889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "0666790c021e4d0f96e96882a8ee3c90"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "62f70b60504dbba72497e395aae0cc55"
server_key_iv: "a83b2ea9b9c45b061ac54d6a7fe6dfee"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.288451 11889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:57.293015 11889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:57.293557 11889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:57.293689 11889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:57.294200 11889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:38:57.295135 11889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:38:57.295182 11889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.295219 11889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:38:57.295240 11889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.304121 11889 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:37979
I20260808 18:38:57.304134 12071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:37979 every 8 connection(s)
I20260808 18:38:57.305156 11889 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:38:57.308795 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 11889
I20260808 18:38:57.308923 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:38:57.309267 4343 external_mini_cluster.cc:1428] Setting key 48dd214a7a67918d0ebdc9bf80cae67f
I20260808 18:38:57.311751 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.306978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:52101 (local address 127.4.61.254:45423)
0808 18:38:57.307102 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.307105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.308097 (+ 992us) server_negotiation.cc:407] Connection header received
0808 18:38:57.309634 (+ 1537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.309638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.309690 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.309775 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.311260 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.311264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.311267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.311283 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.311309 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.311319 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.311413 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.311563 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.311612 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:38:57.312631 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.307328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45423 (local address 127.4.61.195:52101)
0808 18:38:57.307953 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.307992 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.309385 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.310151 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.310158 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.310258 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.310867 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.310870 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.310923 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.311074 (+ 151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.311416 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.311426 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.311432 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.311587 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.311794 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":101,"threads_started":1}
I20260808 18:38:57.313643 12072 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45423
I20260808 18:38:57.313911 12072 heartbeater.cc:464] Registering TS with master...
I20260808 18:38:57.314414 12072 heartbeater.cc:511] Master 127.4.61.254:45423 requested a full tablet report, sending...
I20260808 18:38:57.315560 11398 ts_manager.cc:194] Registered new tserver with Master: 0666790c021e4d0f96e96882a8ee3c90 (127.4.61.195:37979)
I20260808 18:38:57.323379 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:38:57.327111 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.325387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57766 (local address 127.4.61.254:45423)
0808 18:38:57.325515 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.325519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.325720 (+ 201us) server_negotiation.cc:407] Connection header received
0808 18:38:57.325838 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.325840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.325873 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.325939 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.326686 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.326689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.326691 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.326702 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.326725 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.326733 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.326815 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.326963 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.327005 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:38:57.329949 11398 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57766:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:38:57.333397 11398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:38:57.345510 12089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.341841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:37979 (local address 127.0.0.1:39970)
0808 18:38:57.342752 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.342806 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.342909 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.343674 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.343679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.343755 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.344368 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.344370 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.344391 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.344463 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.345142 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.345152 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.345158 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.345269 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.345341 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":109,"threads_started":1}
I20260808 18:38:57.345567 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.341961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39970 (local address 127.4.61.195:37979)
0808 18:38:57.343282 (+ 1321us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.343294 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.343326 (+ 32us) server_negotiation.cc:407] Connection header received
0808 18:38:57.343374 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.343378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.343503 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.343680 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.344920 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.344928 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.344941 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.344956 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.345007 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.345047 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.345170 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.345302 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.345381 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":169,"threads_started":1}
I20260808 18:38:57.345803 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.342136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.4.61.193:42643)
0808 18:38:57.343177 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.343190 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.343219 (+ 29us) server_negotiation.cc:407] Connection header received
0808 18:38:57.343279 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.343285 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.343491 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.343639 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.345014 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.345019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.345028 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.345039 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.345076 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.345113 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.345213 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.345575 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.345649 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":928,"thread_start_us":116,"threads_started":1}
I20260808 18:38:57.345510 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.341896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42643 (local address 127.0.0.1:46228)
0808 18:38:57.343116 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.343128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.343192 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.344362 (+ 1170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.344365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.344380 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.344866 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.344867 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.344875 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.344894 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.345253 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.345256 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.345258 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.345341 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.345366 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1146,"thread_start_us":81,"threads_started":1}
I20260808 18:38:57.346289 12092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.342706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:41873 (local address 127.0.0.1:60298)
0808 18:38:57.343364 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.343375 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.343438 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.344362 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.344365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.344380 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.344811 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.344814 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.344824 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.344853 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.346047 (+ 1194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.346051 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.346054 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.346141 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.346176 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":107,"threads_started":1}
I20260808 18:38:57.347410 12094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.342864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60298 (local address 127.4.61.194:41873)
0808 18:38:57.343406 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.343417 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.343460 (+ 43us) server_negotiation.cc:407] Connection header received
0808 18:38:57.343517 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.343522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.343714 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.343840 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.344969 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.344974 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.344981 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.344993 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.345029 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.345057 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.345170 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.346900 (+ 1730us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.347248 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":156,"threads_started":1}
I20260808 18:38:57.348915 11579 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab325346a2049d9ae5f03a6194480ff (DEFAULT_TABLE table=test-table [id=7a75cec5e5f64365a9740818472b8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:57.348909 11980 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab325346a2049d9ae5f03a6194480ff (DEFAULT_TABLE table=test-table [id=7a75cec5e5f64365a9740818472b8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:57.350023 11579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab325346a2049d9ae5f03a6194480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:57.350063 11980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab325346a2049d9ae5f03a6194480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:57.350087 11795 tablet_service.cc:1467] Processing CreateTablet for tablet 2ab325346a2049d9ae5f03a6194480ff (DEFAULT_TABLE table=test-table [id=7a75cec5e5f64365a9740818472b8ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:38:57.351060 11795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ab325346a2049d9ae5f03a6194480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:57.356196 12095 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Bootstrap starting.
I20260808 18:38:57.357628 12096 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Bootstrap starting.
I20260808 18:38:57.358076 12097 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Bootstrap starting.
I20260808 18:38:57.359509 12095 tablet_bootstrap.cc:654] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:57.359745 12096 tablet_bootstrap.cc:654] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:57.359987 12097 tablet_bootstrap.cc:654] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:57.360430 12095 log.cc:824] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:57.360432 12096 log.cc:824] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:57.360667 12097 log.cc:824] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:57.362473 12097 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: No bootstrap required, opened a new log
I20260808 18:38:57.362569 12096 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: No bootstrap required, opened a new log
I20260808 18:38:57.362568 12095 tablet_bootstrap.cc:492] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: No bootstrap required, opened a new log
I20260808 18:38:57.362672 12097 ts_tablet_manager.cc:1397] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:38:57.362759 12095 ts_tablet_manager.cc:1397] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 18:38:57.362759 12096 ts_tablet_manager.cc:1397] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:38:57.366298 12097 raft_consensus.cc:348] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.366595 12097 raft_consensus.cc:374] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:57.366650 12097 raft_consensus.cc:729] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b0c72318b3b4825aba8ec8c3e17a207, State: Initialized, Role: FOLLOWER
I20260808 18:38:57.367084 12097 consensus_queue.cc:260] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.367233 12096 raft_consensus.cc:348] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.367337 12095 raft_consensus.cc:348] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.367504 12096 raft_consensus.cc:374] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:57.367556 12096 raft_consensus.cc:729] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0666790c021e4d0f96e96882a8ee3c90, State: Initialized, Role: FOLLOWER
I20260808 18:38:57.367561 12095 raft_consensus.cc:374] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:57.367619 12095 raft_consensus.cc:729] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca12d144a594683bcce2edbf79c3556, State: Initialized, Role: FOLLOWER
I20260808 18:38:57.368006 11886 heartbeater.cc:503] Master 127.4.61.254:45423 was elected leader, sending a full tablet report...
I20260808 18:38:57.368013 12096 consensus_queue.cc:260] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.368013 12095 consensus_queue.cc:260] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.368137 12097 ts_tablet_manager.cc:1428] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 18:38:57.368970 12096 ts_tablet_manager.cc:1428] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:38:57.369046 11684 heartbeater.cc:503] Master 127.4.61.254:45423 was elected leader, sending a full tablet report...
I20260808 18:38:57.369076 12072 heartbeater.cc:503] Master 127.4.61.254:45423 was elected leader, sending a full tablet report...
I20260808 18:38:57.369974 12095 ts_tablet_manager.cc:1428] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260808 18:38:57.373857 11887 tablet.cc:2369] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:38:57.444150 11686 tablet.cc:2369] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:57.519619 12104 raft_consensus.cc:482] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:38:57.519851 12104 raft_consensus.cc:504] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.521037 12104 leader_election.cc:288] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eca12d144a594683bcce2edbf79c3556 (127.4.61.193:42643), 9b0c72318b3b4825aba8ec8c3e17a207 (127.4.61.194:41873)
I20260808 18:38:57.523052 12094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.521436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:52729 (local address 127.4.61.194:41873)
0808 18:38:57.521566 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.521570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.521870 (+ 300us) server_negotiation.cc:407] Connection header received
0808 18:38:57.521956 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.521959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.521997 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.522057 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.522685 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.522688 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.522691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.522702 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.522722 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.522732 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.522806 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.522876 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.522918 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:38:57.523072 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.521346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42643 (local address 127.4.61.195:54131)
0808 18:38:57.521581 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.521596 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.521701 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.521959 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.521962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.521977 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.522457 (+ 480us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.522459 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.522472 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.522505 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.522789 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.522792 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.522796 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.522880 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.522931 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260808 18:38:57.523092 12107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.521346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:41873 (local address 127.4.61.195:52729)
0808 18:38:57.521760 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.521771 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:57.521878 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:57.522098 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:57.522101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:57.522114 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:38:57.522544 (+ 430us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:38:57.522546 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:38:57.522555 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:38:57.522576 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:38:57.522806 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:38:57.522808 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:38:57.522811 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 18:38:57.522880 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:38:57.522939 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":64,"thread_start_us":128,"threads_started":1}
I20260808 18:38:57.523315 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.521463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:54131 (local address 127.4.61.193:42643)
0808 18:38:57.521582 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.521586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.521661 (+ 75us) server_negotiation.cc:407] Connection header received
0808 18:38:57.521793 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.521796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.521832 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.521915 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.522631 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.522636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.522638 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.522652 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.522676 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.522687 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.522806 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.523132 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.523174 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:38:57.523864 11824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab325346a2049d9ae5f03a6194480ff" candidate_uuid: "0666790c021e4d0f96e96882a8ee3c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" is_pre_election: true
I20260808 18:38:57.523875 11608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab325346a2049d9ae5f03a6194480ff" candidate_uuid: "0666790c021e4d0f96e96882a8ee3c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca12d144a594683bcce2edbf79c3556" is_pre_election: true
I20260808 18:38:57.524209 11824 raft_consensus.cc:2454] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0666790c021e4d0f96e96882a8ee3c90 in term 0.
I20260808 18:38:57.524209 11608 raft_consensus.cc:2454] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0666790c021e4d0f96e96882a8ee3c90 in term 0.
I20260808 18:38:57.524734 11913 leader_election.cc:302] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0666790c021e4d0f96e96882a8ee3c90, 9b0c72318b3b4825aba8ec8c3e17a207, eca12d144a594683bcce2edbf79c3556; no voters:
I20260808 18:38:57.525053 12104 raft_consensus.cc:2781] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:38:57.525175 12104 raft_consensus.cc:482] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:38:57.525225 12104 raft_consensus.cc:3037] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 0 FOLLOWER]: Advancing to term 1
W20260808 18:38:57.556195 12073 tablet.cc:2369] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:38:57.604342 12104 raft_consensus.cc:504] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.604878 12104 leader_election.cc:288] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [CANDIDATE]: Term 1 election: Requested vote from peers eca12d144a594683bcce2edbf79c3556 (127.4.61.193:42643), 9b0c72318b3b4825aba8ec8c3e17a207 (127.4.61.194:41873)
I20260808 18:38:57.605386 11824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab325346a2049d9ae5f03a6194480ff" candidate_uuid: "0666790c021e4d0f96e96882a8ee3c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b0c72318b3b4825aba8ec8c3e17a207"
I20260808 18:38:57.605386 11608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ab325346a2049d9ae5f03a6194480ff" candidate_uuid: "0666790c021e4d0f96e96882a8ee3c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca12d144a594683bcce2edbf79c3556"
I20260808 18:38:57.605547 11824 raft_consensus.cc:3037] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:57.605547 11608 raft_consensus.cc:3037] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:57.606987 11608 raft_consensus.cc:2454] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0666790c021e4d0f96e96882a8ee3c90 in term 1.
I20260808 18:38:57.607278 11824 raft_consensus.cc:2454] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0666790c021e4d0f96e96882a8ee3c90 in term 1.
I20260808 18:38:57.607401 11911 leader_election.cc:302] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0666790c021e4d0f96e96882a8ee3c90, eca12d144a594683bcce2edbf79c3556; no voters:
I20260808 18:38:57.607601 12104 raft_consensus.cc:2781] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:57.607828 12104 raft_consensus.cc:686] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 1 LEADER]: Becoming Leader. State: Replica: 0666790c021e4d0f96e96882a8ee3c90, State: Running, Role: LEADER
I20260808 18:38:57.608202 12104 consensus_queue.cc:237] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } }
I20260808 18:38:57.611398 11398 catalog_manager.cc:5495] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0666790c021e4d0f96e96882a8ee3c90 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "0666790c021e4d0f96e96882a8ee3c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0666790c021e4d0f96e96882a8ee3c90" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 37979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 } health_report { overall_health: UNKNOWN } } }
I20260808 18:38:57.637573 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.636288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.4.61.195:37979)
0808 18:38:57.636413 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.636417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.636430 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:38:57.636510 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.636513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.636576 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.636647 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.637226 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.637229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.637231 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.637242 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.637295 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.637307 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.637384 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.637430 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.637466 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:38:57.643778 11608 raft_consensus.cc:1261] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 1 FOLLOWER]: Refusing update from remote peer 0666790c021e4d0f96e96882a8ee3c90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:57.643978 11824 raft_consensus.cc:1261] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 1 FOLLOWER]: Refusing update from remote peer 0666790c021e4d0f96e96882a8ee3c90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:38:57.644630 12109 consensus_queue.cc:1035] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b0c72318b3b4825aba8ec8c3e17a207" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:57.644821 12104 consensus_queue.cc:1035] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eca12d144a594683bcce2edbf79c3556" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:38:57.650732 12115 mvcc.cc:205] Tried to move back new op lower bound from 7316333926980939776 to 7316333926845870080. Current Snapshot: MvccSnapshot[applied={T|T < 7316333926980939776}]
I20260808 18:38:57.654016 12116 mvcc.cc:205] Tried to move back new op lower bound from 7316333926980939776 to 7316333926845870080. Current Snapshot: MvccSnapshot[applied={T|T < 7316333926980939776}]
I20260808 18:38:57.660848 11396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:57.660995 11396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:38:57.663218 11396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 81a4800fde674693bbf2e5621d147d31: Sending DeleteTablet for 3 replicas of tablet 2ab325346a2049d9ae5f03a6194480ff
I20260808 18:38:57.664041 11795 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab325346a2049d9ae5f03a6194480ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:57 UTC) from {username='slave'} at 127.0.0.1:60298
I20260808 18:38:57.664145 11980 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab325346a2049d9ae5f03a6194480ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:57 UTC) from {username='slave'} at 127.0.0.1:39970
I20260808 18:38:57.664858 11579 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ab325346a2049d9ae5f03a6194480ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:38:57 UTC) from {username='slave'} at 127.0.0.1:46228
I20260808 18:38:57.665323 12131 tablet_replica.cc:330] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556: stopping tablet replica
I20260808 18:38:57.665719 12131 raft_consensus.cc:2229] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:57.665874 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 11491
I20260808 18:38:57.666204 12131 raft_consensus.cc:2258] T 2ab325346a2049d9ae5f03a6194480ff P eca12d144a594683bcce2edbf79c3556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:57.669875 12129 tablet_replica.cc:330] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: stopping tablet replica
I20260808 18:38:57.670746 12129 raft_consensus.cc:2229] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:38:57.671218 12129 raft_consensus.cc:2258] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:57.671607 12130 tablet_replica.cc:330] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: stopping tablet replica
I20260808 18:38:57.672004 12130 raft_consensus.cc:2229] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:38:57.672326 12130 raft_consensus.cc:2258] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:38:57.673734 12130 ts_tablet_manager.cc:1905] T 2ab325346a2049d9ae5f03a6194480ff P 9b0c72318b3b4825aba8ec8c3e17a207: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:38:57.675529 12129 ts_tablet_manager.cc:1905] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 18:38:57.682780 11372 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:42643 (error 108)
I20260808 18:38:57.682976 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 11688
I20260808 18:38:57.688975 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.688667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42643 (local address 127.0.0.1:46244)
0808 18:38:57.688812 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.688887 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:42643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 18:38:57.689147 11372 catalog_manager.cc:4584] TS eca12d144a594683bcce2edbf79c3556 (127.4.61.193:42643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ab325346a2049d9ae5f03a6194480ff: Network error: Client connection negotiation failed: client connection to 127.4.61.193:42643: connect: Connection refused (error 111)
I20260808 18:38:57.702598 12129 ts_tablet_manager.cc:1918] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:38:57.702742 12129 log.cc:1196] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/2ab325346a2049d9ae5f03a6194480ff
I20260808 18:38:57.703074 12129 ts_tablet_manager.cc:1939] T 2ab325346a2049d9ae5f03a6194480ff P 0666790c021e4d0f96e96882a8ee3c90: Deleting consensus metadata
I20260808 18:38:57.708328 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 11889
I20260808 18:38:57.708462 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.708150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:41873 (local address 127.0.0.1:60306)
0808 18:38:57.708303 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:57.708363 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.194:41873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 18:38:57.728441 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 11346
2026-08-08T18:38:57Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1270 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 18:38:57.755766 4343 mini_oidc.cc:152] Starting JWKS server
I20260808 18:38:57.757501 4343 webserver.cc:460] Webserver started at https://127.0.0.1:33249/ using document root <none> and password file <none>
I20260808 18:38:57.757685 4343 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 18:38:57.757969 4343 webserver.cc:460] Webserver started at http://127.0.0.1:37555/ using document root <none> and password file <none>
2026-08-08T18:38:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:57Z Disabled control of system clock
I20260808 18:38:57.767855 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:38085
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:46339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:38085
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33249/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/testchainca.cert with env {}
W20260808 18:38:57.881285 12141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:57.881572 12141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:57.881608 12141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:57.886045 12141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:57.886116 12141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:57.886130 12141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:57.886145 12141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:57.886160 12141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 18:38:57.886188 12141 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 18:38:57.886211 12141 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33249/jwks.json
I20260808 18:38:57.891812 12141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:38085
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:38085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33249/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:57.893005 12141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:57.894047 12141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:57.902347 12151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:57.902375 12154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:57.902375 12148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:57.902402 12141 server_base.cc:1034] running on GCE node
I20260808 18:38:57.903122 12141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:57.904173 12141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:57.905335 12141 hybrid_clock.cc:648] HybridClock initialized: now 1786214337905313 us; error 30 us; skew 500 ppm
I20260808 18:38:57.907109 12141 webserver.cc:460] Webserver started at http://127.4.61.254:35345/ using document root <none> and password file <none>
I20260808 18:38:57.907680 12141 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:57.907759 12141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:57.907954 12141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:57.909967 12141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "88b1d77eb7dd44be9db5cd3605232b67"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "3b16cded3619cb2949470caa11c9ddfd"
server_key_iv: "cef1f9a14a15e71585342e79f3bf058e"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.910542 12141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "88b1d77eb7dd44be9db5cd3605232b67"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "3b16cded3619cb2949470caa11c9ddfd"
server_key_iv: "cef1f9a14a15e71585342e79f3bf058e"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.914053 12141 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:57.916824 12162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:57.918015 12141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:57.918134 12141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "88b1d77eb7dd44be9db5cd3605232b67"
format_stamp: "Formatted at 2026-08-08 18:38:57 on dist-test-slave-fgb3"
server_key: "3b16cded3619cb2949470caa11c9ddfd"
server_key_iv: "cef1f9a14a15e71585342e79f3bf058e"
server_key_version: "encryptionkey@0"
I20260808 18:38:57.918224 12141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:57.943641 12141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:57.944382 12141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:57.944563 12141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:57.952086 12141 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:38085
I20260808 18:38:57.952090 12251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:38085 every 8 connection(s)
I20260808 18:38:57.953016 12141 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:57.953747 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12141
I20260808 18:38:57.953871 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:57.954192 4343 external_mini_cluster.cc:1428] Setting key 113ce7c71c33e103636d26803be3f7d7
I20260808 18:38:57.956956 12252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:57.963851 12252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: Bootstrap starting.
I20260808 18:38:57.964946 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:57.955615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35464 (local address 127.4.61.254:38085)
0808 18:38:57.956274 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:57.956314 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:57.956359 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:38:57.957224 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:57.957255 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:57.957759 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:57.958144 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:57.958627 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:57.960067 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:57.961040 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:57.961723 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:57.961901 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:57.962869 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:57.962876 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:57.962892 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:57.963391 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:57.963465 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:57.963493 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:57.963591 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:57.963758 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 18:38:57.964035 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":125,"threads_started":1}
I20260808 18:38:57.966329 12252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:57.967144 12252 log.cc:824] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:57.967702 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:38:57.968966 12252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: No bootstrap required, opened a new log
I20260808 18:38:57.972333 12252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } }
I20260808 18:38:57.972550 12252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:57.972595 12252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88b1d77eb7dd44be9db5cd3605232b67, State: Initialized, Role: FOLLOWER
I20260808 18:38:57.973034 12252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } }
I20260808 18:38:57.973169 12252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:57.973289 12252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:57.973402 12252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:57.988754 12252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } }
I20260808 18:38:57.989266 12252 leader_election.cc:302] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88b1d77eb7dd44be9db5cd3605232b67; no voters:
I20260808 18:38:57.989647 12252 leader_election.cc:288] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:57.989907 12263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:57.990176 12263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [term 1 LEADER]: Becoming Leader. State: Replica: 88b1d77eb7dd44be9db5cd3605232b67, State: Running, Role: LEADER
I20260808 18:38:57.990607 12263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } }
I20260808 18:38:57.991204 12252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:57.992448 12265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88b1d77eb7dd44be9db5cd3605232b67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } } }
I20260808 18:38:57.992597 12265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:57.993024 12266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88b1d77eb7dd44be9db5cd3605232b67. Latest consensus state: current_term: 1 leader_uuid: "88b1d77eb7dd44be9db5cd3605232b67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b1d77eb7dd44be9db5cd3605232b67" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38085 } } }
I20260808 18:38:57.993176 12266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67 [sys.catalog]: This master's current role is: LEADER
W20260808 18:38:57.996188 12286 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:38:57.996259 12286 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:38:57.996333 12275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:57.997036 12275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:58.002844 12275 catalog_manager.cc:1347] Generated new cluster ID: 0ac0f2422b224c00a7c4121a068076b7
I20260808 18:38:58.002916 12275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:58.009878 12275 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:58.011137 12275 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:58.021005 12275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88b1d77eb7dd44be9db5cd3605232b67: Generated new TSK 0
I20260808 18:38:58.021854 12275 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 18:38:58.058070 12308 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 18:38:58.058436 12308 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 18:38:58.059036 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.033879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.4.61.254:38085)
0808 18:38:58.034017 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.034022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.034233 (+ 211us) server_negotiation.cc:407] Connection header received
0808 18:38:58.034485 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.034487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.034537 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.034621 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0808 18:38:58.034921 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.035456 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.036662 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.036880 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.036953 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.037312 (+ 359us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 18:38:58.058474 (+ 21162us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 18:38:58.058877 (+ 403us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 18:38:58.059116 12261 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 18:38:58.060437 12305 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:38:58.033790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:38085 (local address 127.0.0.1:35480)
0808 18:38:58.034150 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:58.034165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:58.034306 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:58.034654 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:58.034658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:58.034672 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0808 18:38:58.034814 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.034822 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.035555 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.035559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.036554 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.036564 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.036982 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.036986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.037080 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.037136 (+ 56us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 18:38:58.058799 (+ 21663us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 18:38:58.059114 (+ 315us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.61.254:38085: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":101,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.4.61.254:38085: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 18:38:58.061165 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12141
2026-08-08T18:38:58Z chronyd exiting
I20260808 18:38:58.116497 4343 test_util.cc:175] -----------------------------------------------
I20260808 18:38:58.116588 4343 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786214311986709-4343-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (362 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 18:38:58.117674 4343 mini_oidc.cc:152] Starting JWKS server
I20260808 18:38:58.118604 4343 webserver.cc:460] Webserver started at https://127.0.0.1:34055/ using document root <none> and password file <none>
I20260808 18:38:58.118706 4343 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 18:38:58.118954 4343 webserver.cc:460] Webserver started at http://127.0.0.1:35375/ using document root <none> and password file <none>
2026-08-08T18:38:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:58Z Disabled control of system clock
I20260808 18:38:58.128962 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33023
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:46777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:33023
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34055/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/testchainca.cert with env {}
W20260808 18:38:58.241282 12314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:58.241562 12314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:58.241600 12314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:58.245587 12314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:58.245654 12314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:58.245669 12314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:58.245685 12314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:58.245699 12314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 18:38:58.245713 12314 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 18:38:58.245725 12314 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34055/jwks.json
I20260808 18:38:58.251257 12314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:33023
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34055/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:58.252323 12314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:58.253302 12314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:58.261762 12327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.261782 12323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.261777 12322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:58.262184 12314 server_base.cc:1034] running on GCE node
I20260808 18:38:58.262804 12314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:58.264098 12314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:58.265297 12314 hybrid_clock.cc:648] HybridClock initialized: now 1786214338265278 us; error 34 us; skew 500 ppm
I20260808 18:38:58.271175 12314 webserver.cc:460] Webserver started at http://127.4.61.254:41479/ using document root <none> and password file <none>
I20260808 18:38:58.271821 12314 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:58.271898 12314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:58.272094 12314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:58.274290 12314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "4b80ee6e43594fee87e0e32d267d7ec1"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "d686fdbbb22f5cb64cbda5ef12e9b739"
server_key_iv: "7617641619560abbcb1ed063291fed3f"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.274931 12314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "4b80ee6e43594fee87e0e32d267d7ec1"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "d686fdbbb22f5cb64cbda5ef12e9b739"
server_key_iv: "7617641619560abbcb1ed063291fed3f"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.278654 12314 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:38:58.281123 12339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:58.282421 12314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:58.282537 12314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "4b80ee6e43594fee87e0e32d267d7ec1"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "d686fdbbb22f5cb64cbda5ef12e9b739"
server_key_iv: "7617641619560abbcb1ed063291fed3f"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.282640 12314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:58.306908 12314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:58.307662 12314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:58.307868 12314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:58.314954 12314 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:33023
I20260808 18:38:58.315009 12413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:33023 every 8 connection(s)
I20260808 18:38:58.315948 12314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:58.319247 12415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:58.325064 12415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: Bootstrap starting.
I20260808 18:38:58.325352 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12314
I20260808 18:38:58.325484 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:58.325776 4343 external_mini_cluster.cc:1428] Setting key fcacd7919805769c66978fc538c39d13
I20260808 18:38:58.327909 12415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:58.328646 12415 log.cc:824] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:58.330830 12415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: No bootstrap required, opened a new log
I20260808 18:38:58.335031 12415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } }
I20260808 18:38:58.335280 12415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:58.335325 12415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b80ee6e43594fee87e0e32d267d7ec1, State: Initialized, Role: FOLLOWER
I20260808 18:38:58.335785 12421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.327178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43696 (local address 127.4.61.254:33023)
0808 18:38:58.327876 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.327890 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.327926 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:38:58.328633 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.328653 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.329119 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.329533 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:58.329883 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.330926 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.332153 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.332699 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.332838 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.333761 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:58.333767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:58.333781 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:58.334213 (+ 432us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:58.334278 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:58.334301 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:58.334445 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:58.334614 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 18:38:58.334921 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":152,"threads_started":1}
I20260808 18:38:58.335764 12415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } }
I20260808 18:38:58.335886 12415 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:58.335937 12415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:58.336031 12415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:58.338672 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:38:58.340273 12415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } }
I20260808 18:38:58.340718 12415 leader_election.cc:302] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b80ee6e43594fee87e0e32d267d7ec1; no voters:
I20260808 18:38:58.341086 12415 leader_election.cc:288] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:58.341197 12426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:58.341425 12426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [term 1 LEADER]: Becoming Leader. State: Replica: 4b80ee6e43594fee87e0e32d267d7ec1, State: Running, Role: LEADER
I20260808 18:38:58.342097 12426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } }
I20260808 18:38:58.342480 12415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:58.343408 12426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b80ee6e43594fee87e0e32d267d7ec1. Latest consensus state: current_term: 1 leader_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } } }
I20260808 18:38:58.344144 12426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:58.344028 12428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b80ee6e43594fee87e0e32d267d7ec1" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33023 } } }
I20260808 18:38:58.345271 12428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1 [sys.catalog]: This master's current role is: LEADER
W20260808 18:38:58.347347 12442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:38:58.347425 12442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:38:58.347497 12441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:58.348260 12441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:58.354048 12441 catalog_manager.cc:1347] Generated new cluster ID: a2508b177e374a9597a252fa7a6d7f75
I20260808 18:38:58.354122 12441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:58.375545 12441 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:58.376535 12441 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:58.382042 12441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b80ee6e43594fee87e0e32d267d7ec1: Generated new TSK 0
I20260808 18:38:58.382817 12441 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 18:38:58.413161 12455 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 18:38:58.413261 12455 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 18:38:58.413861 12421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.398426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.4.61.254:33023)
0808 18:38:58.398553 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.398557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.398682 (+ 125us) server_negotiation.cc:407] Connection header received
0808 18:38:58.398848 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.398850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.398899 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.398988 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0808 18:38:58.399231 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.399780 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.401008 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.401221 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.401291 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.401594 (+ 303us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 18:38:58.413529 (+ 11935us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 18:38:58.413747 (+ 218us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43698: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 18:38:58.413919 12421 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43698: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 18:38:58.414079 12454 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:38:58.398256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33023 (local address 127.0.0.1:43698)
0808 18:38:58.398593 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:58.398608 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:58.398732 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:58.399009 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:58.399012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:58.399020 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 18:38:58.399143 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.399149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.399887 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.399891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.400903 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.400914 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.401320 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.401324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.401412 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.401449 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 18:38:58.413709 (+ 12260us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 18:38:58.413904 (+ 195us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.61.254:33023: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":131,"threads_started":1}
I20260808 18:38:58.414789 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12314
2026-08-08T18:38:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (348 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 18:38:58.466423 4343 mini_oidc.cc:152] Starting JWKS server
I20260808 18:38:58.467303 4343 webserver.cc:460] Webserver started at https://127.0.0.1:32861/ using document root <none> and password file <none>
I20260808 18:38:58.467392 4343 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 18:38:58.467610 4343 webserver.cc:460] Webserver started at http://127.0.0.1:37131/ using document root <none> and password file <none>
2026-08-08T18:38:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:58Z Disabled control of system clock
I20260808 18:38:58.477691 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43155
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:43155
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32861/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 18:38:58.593670 12463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:58.593925 12463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:58.593962 12463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:58.598078 12463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:58.598132 12463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:58.598146 12463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:58.598161 12463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:58.598176 12463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 18:38:58.598189 12463 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 18:38:58.598201 12463 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32861/jwks.json
I20260808 18:38:58.602784 12463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:43155
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32861/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:58.603701 12463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:58.604928 12463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:58.612821 12471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.612867 12470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.612885 12474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:58.612954 12463 server_base.cc:1034] running on GCE node
I20260808 18:38:58.613641 12463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:58.614847 12463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:58.616010 12463 hybrid_clock.cc:648] HybridClock initialized: now 1786214338615992 us; error 33 us; skew 500 ppm
I20260808 18:38:58.617820 12463 webserver.cc:460] Webserver started at http://127.4.61.254:36023/ using document root <none> and password file <none>
I20260808 18:38:58.618448 12463 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:58.618525 12463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:58.618729 12463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:58.620800 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "598b5bb691dd492e9fd7c428544e388d"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "ce55e59ed6281d1be864f36c1ef33926"
server_key_iv: "1fbad0e41bff4cab0497f0c4b22dc58e"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.621342 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "598b5bb691dd492e9fd7c428544e388d"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "ce55e59ed6281d1be864f36c1ef33926"
server_key_iv: "1fbad0e41bff4cab0497f0c4b22dc58e"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.624886 12463 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 18:38:58.627279 12481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:58.628436 12463 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:38:58.628552 12463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "598b5bb691dd492e9fd7c428544e388d"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "ce55e59ed6281d1be864f36c1ef33926"
server_key_iv: "1fbad0e41bff4cab0497f0c4b22dc58e"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.628652 12463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:58.642055 12463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:58.642777 12463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:58.642957 12463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:58.649585 12463 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:43155
I20260808 18:38:58.649601 12560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:43155 every 8 connection(s)
I20260808 18:38:58.650579 12463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:58.653759 12561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:58.653976 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12463
I20260808 18:38:58.654088 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:58.654418 4343 external_mini_cluster.cc:1428] Setting key e47fcfb4fc023731c24ed94634d9130c
I20260808 18:38:58.660357 12561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d: Bootstrap starting.
I20260808 18:38:58.662681 12561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:58.663427 12561 log.cc:824] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:58.663497 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.655753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55826 (local address 127.4.61.254:43155)
0808 18:38:58.656385 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.656399 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.656434 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:38:58.657133 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.657150 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.657547 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.657859 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:58.658342 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.659363 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.660258 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.660788 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.660943 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.661787 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:58.661793 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:58.661806 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:58.662179 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:58.662235 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:58.662264 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:58.662383 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:58.662506 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 18:38:58.662764 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":290,"thread_start_us":124,"threads_started":1}
I20260808 18:38:58.665534 12561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d: No bootstrap required, opened a new log
I20260808 18:38:58.666550 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:38:58.669737 12561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } }
I20260808 18:38:58.669975 12561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:58.670023 12561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598b5bb691dd492e9fd7c428544e388d, State: Initialized, Role: FOLLOWER
I20260808 18:38:58.670471 12561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } }
I20260808 18:38:58.670603 12561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:58.670665 12561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:58.670759 12561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:58.671684 12561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } }
I20260808 18:38:58.672005 12561 leader_election.cc:302] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 598b5bb691dd492e9fd7c428544e388d; no voters:
I20260808 18:38:58.672286 12561 leader_election.cc:288] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:58.672398 12567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:58.672626 12567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [term 1 LEADER]: Becoming Leader. State: Replica: 598b5bb691dd492e9fd7c428544e388d, State: Running, Role: LEADER
I20260808 18:38:58.672955 12567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } }
I20260808 18:38:58.673547 12561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:58.674044 12567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 598b5bb691dd492e9fd7c428544e388d. Latest consensus state: current_term: 1 leader_uuid: "598b5bb691dd492e9fd7c428544e388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } } }
I20260808 18:38:58.674161 12567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:58.674563 12568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "598b5bb691dd492e9fd7c428544e388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "598b5bb691dd492e9fd7c428544e388d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43155 } } }
I20260808 18:38:58.674702 12575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:58.674710 12568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:58.678122 12575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:58.683774 12575 catalog_manager.cc:1347] Generated new cluster ID: 1b21d2910831449cb7549cf1100f307c
I20260808 18:38:58.683847 12575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:58.701015 12575 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:58.702428 12575 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:58.710232 12575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 598b5bb691dd492e9fd7c428544e388d: Generated new TSK 0
I20260808 18:38:58.711159 12575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:38:58.732775 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.727731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55828 (local address 127.4.61.254:43155)
0808 18:38:58.727872 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.727876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.727946 (+ 70us) server_negotiation.cc:407] Connection header received
0808 18:38:58.728123 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.728125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.728177 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.728271 (+ 94us) server_negotiation.cc:226] Negotiated authn=JWT
0808 18:38:58.728518 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.729085 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.730305 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.730583 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.730660 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.731031 (+ 371us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 18:38:58.732386 (+ 1355us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 18:38:58.732627 (+ 241us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55828: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 18:38:58.732885 12606 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:38:58.727528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43155 (local address 127.0.0.1:55828)
0808 18:38:58.727845 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:58.727860 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:58.727997 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:58.728287 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:58.728290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:58.728298 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 18:38:58.728423 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.728430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.729194 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.729197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.730199 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:58.730210 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.730696 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.730700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:58.730823 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.730855 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 18:38:58.732549 (+ 1694us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 18:38:58.732694 (+ 145us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.61.254:43155: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":117,"threads_started":1}
W20260808 18:38:58.733318 12565 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55828: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260808 18:38:58.733669 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12463
E20260808 18:38:58.750623 12608 webserver.cc:533] Webserver: sslize failed:
E20260808 18:38:58.750710 12608 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T18:38:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (315 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T18:38:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:38:58Z Disabled control of system clock
I20260808 18:38:58.791255 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40495
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40495
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/testchainca.cert with env {}
W20260808 18:38:58.904446 12613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:38:58.904724 12613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:38:58.904781 12613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:38:58.908803 12613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:38:58.908867 12613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:38:58.908888 12613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:38:58.908910 12613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:38:58.908939 12613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 18:38:58.908969 12613 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 18:38:58.908990 12613 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 18:38:58.914263 12613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40495
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:38:58.915385 12613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:38:58.916401 12613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:38:58.925160 12620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.925179 12619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:38:58.925436 12623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:38:58.925793 12613 server_base.cc:1034] running on GCE node
I20260808 18:38:58.926489 12613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:38:58.927582 12613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:38:58.928748 12613 hybrid_clock.cc:648] HybridClock initialized: now 1786214338928722 us; error 40 us; skew 500 ppm
I20260808 18:38:58.930631 12613 webserver.cc:460] Webserver started at http://127.4.61.254:41593/ using document root <none> and password file <none>
I20260808 18:38:58.931205 12613 fs_manager.cc:359] Metadata directory not provided
I20260808 18:38:58.931270 12613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:38:58.931463 12613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:38:58.933516 12613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "38a4263113f3487f8af020dba634a181"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "22ee0cb54c7c84455ca3746b7c5ad550"
server_key_iv: "f9637085e175fddad469966ed42e23f9"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.934084 12613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "38a4263113f3487f8af020dba634a181"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "22ee0cb54c7c84455ca3746b7c5ad550"
server_key_iv: "f9637085e175fddad469966ed42e23f9"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.937747 12613 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:38:58.940227 12631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:38:58.941457 12613 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:38:58.941576 12613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "38a4263113f3487f8af020dba634a181"
format_stamp: "Formatted at 2026-08-08 18:38:58 on dist-test-slave-fgb3"
server_key: "22ee0cb54c7c84455ca3746b7c5ad550"
server_key_iv: "f9637085e175fddad469966ed42e23f9"
server_key_version: "encryptionkey@0"
I20260808 18:38:58.941677 12613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:38:58.969297 12613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:38:58.970057 12613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:38:58.970249 12613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:38:58.977123 12613 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40495
I20260808 18:38:58.977185 12715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40495 every 8 connection(s)
I20260808 18:38:58.978149 12613 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:38:58.981442 12716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:38:58.987308 12716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181: Bootstrap starting.
I20260808 18:38:58.987533 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12613
I20260808 18:38:58.987650 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:38:58.987911 4343 external_mini_cluster.cc:1428] Setting key 08c4269f6656ae6f76895e415670ff7a
I20260808 18:38:58.989882 12716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181: Neither blocks nor log segments found. Creating new log.
I20260808 18:38:58.990653 12716 log.cc:824] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181: Log is configured to *not* fsync() on all Append() calls
I20260808 18:38:58.992482 12716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181: No bootstrap required, opened a new log
I20260808 18:38:58.996030 12716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } }
I20260808 18:38:58.996300 12716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:38:58.996362 12716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a4263113f3487f8af020dba634a181, State: Initialized, Role: FOLLOWER
I20260808 18:38:58.996814 12716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } }
I20260808 18:38:58.996938 12716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:38:58.996979 12720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:58.989241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37386 (local address 127.4.61.254:40495)
0808 18:38:58.989900 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:58.989915 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:58.989956 (+ 41us) server_negotiation.cc:407] Connection header received
0808 18:38:58.990657 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:58.990677 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:58.991109 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:58.991425 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:38:58.991863 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.992853 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.993731 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:58.994217 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:58.994395 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:58.995224 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:38:58.995229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:38:58.995241 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:38:58.995615 (+ 374us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:38:58.995673 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:38:58.995693 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:38:58.995778 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:38:58.995921 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 18:38:58.996166 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":128,"threads_started":1}
I20260808 18:38:58.997000 12716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:38:58.997140 12716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:38:58.998008 12716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } }
I20260808 18:38:58.998369 12716 leader_election.cc:302] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38a4263113f3487f8af020dba634a181; no voters:
I20260808 18:38:58.998675 12716 leader_election.cc:288] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:38:58.998765 12727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:38:58.998970 12727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [term 1 LEADER]: Becoming Leader. State: Replica: 38a4263113f3487f8af020dba634a181, State: Running, Role: LEADER
I20260808 18:38:58.999254 12727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } }
I20260808 18:38:58.999724 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:38:58.999961 12716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:38:59.000844 12730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38a4263113f3487f8af020dba634a181. Latest consensus state: current_term: 1 leader_uuid: "38a4263113f3487f8af020dba634a181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } } }
I20260808 18:38:59.000977 12730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:59.001291 12728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38a4263113f3487f8af020dba634a181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38a4263113f3487f8af020dba634a181" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40495 } } }
I20260808 18:38:59.001384 12728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181 [sys.catalog]: This master's current role is: LEADER
I20260808 18:38:59.001446 12738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:38:59.004298 12738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:38:59.009593 12738 catalog_manager.cc:1347] Generated new cluster ID: 00915a04729345f3bf018138beeff03a
I20260808 18:38:59.009654 12738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:38:59.016634 12738 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:38:59.017808 12738 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:38:59.024802 12738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38a4263113f3487f8af020dba634a181: Generated new TSK 0
I20260808 18:38:59.025566 12738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:38:59.073242 12720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:38:59.037693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.4.61.254:40495)
0808 18:38:59.037826 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:38:59.037831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:38:59.038061 (+ 230us) server_negotiation.cc:407] Connection header received
0808 18:38:59.038192 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:38:59.038194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:38:59.038243 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:38:59.038368 (+ 125us) server_negotiation.cc:226] Negotiated authn=JWT
0808 18:38:59.038584 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:59.039126 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:59.040357 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:38:59.040578 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:38:59.040652 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:59.040977 (+ 325us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 18:38:59.072819 (+ 31842us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 18:38:59.073111 (+ 292us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37388: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 18:38:59.073336 12720 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37388: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 18:38:59.073519 12761 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:38:59.037628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40495 (local address 127.0.0.1:37388)
0808 18:38:59.037930 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 18:38:59.037945 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:38:59.038080 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:38:59.038361 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:38:59.038364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:38:59.038372 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 18:38:59.038490 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:59.038497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:59.039226 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:59.039230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:59.040229 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:38:59.040240 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:38:59.040689 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:38:59.040693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:38:59.040799 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:38:59.040830 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 18:38:59.073074 (+ 32244us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 18:38:59.073315 (+ 241us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.61.254:40495: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
I20260808 18:38:59.074158 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12613
2026-08-08T18:38:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (316 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (124 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (127 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:38:59 dist-test-slave-fgb3 krb5kdc[12776](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:38:59 dist-test-slave-fgb3 krb5kdc[12776](info): set up 2 sockets
Aug 08 18:38:59 dist-test-slave-fgb3 krb5kdc[12776](info): commencing operation
krb5kdc: starting...
W20260808 18:39:00.464877 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:00 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:39:00.589738 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:38333
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:38333
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:00.701442 12797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:00.701719 12797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:00.701778 12797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:00.705777 12797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:00.705842 12797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:00.705868 12797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:00.705888 12797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:00.705917 12797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:00.711215 12797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:38333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:38333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:00.712332 12797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:00.713361 12797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:00.721772 12811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:00.721779 12808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:00.721789 12807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:00.722021 12797 server_base.cc:1034] running on GCE node
I20260808 18:39:00.722756 12797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:00.723951 12797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:00.725112 12797 hybrid_clock.cc:648] HybridClock initialized: now 1786214340725095 us; error 27 us; skew 500 ppm
Aug 08 18:39:00 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214340, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:00.727828 12797 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:39:00.728716 12797 webserver.cc:460] Webserver started at http://127.4.61.254:46587/ using document root <none> and password file <none>
I20260808 18:39:00.729255 12797 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:00.729317 12797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:00.729542 12797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:00.731676 12797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "71a93d48608a433b8f77d50a26c38d34"
format_stamp: "Formatted at 2026-08-08 18:39:00 on dist-test-slave-fgb3"
server_key: "fddaff551450b2c1075004049d076587"
server_key_iv: "91397d8af98d018224714ea31b1ead9e"
server_key_version: "encryptionkey@0"
I20260808 18:39:00.732239 12797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "71a93d48608a433b8f77d50a26c38d34"
format_stamp: "Formatted at 2026-08-08 18:39:00 on dist-test-slave-fgb3"
server_key: "fddaff551450b2c1075004049d076587"
server_key_iv: "91397d8af98d018224714ea31b1ead9e"
server_key_version: "encryptionkey@0"
I20260808 18:39:00.735994 12797 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 18:39:00.738444 12824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:00.739682 12797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:00.739804 12797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "71a93d48608a433b8f77d50a26c38d34"
format_stamp: "Formatted at 2026-08-08 18:39:00 on dist-test-slave-fgb3"
server_key: "fddaff551450b2c1075004049d076587"
server_key_iv: "91397d8af98d018224714ea31b1ead9e"
server_key_version: "encryptionkey@0"
I20260808 18:39:00.739904 12797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:00.785900 12797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:00.788902 12797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:00.789108 12797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:00.796382 12797 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:38333
I20260808 18:39:00.796391 12900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:38333 every 8 connection(s)
I20260808 18:39:00.797441 12797 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:00.797659 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12797
I20260808 18:39:00.797814 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:00.798213 4343 external_mini_cluster.cc:1428] Setting key d7f0d57f3e7a98eb2d7a2e2eb72d4fad
I20260808 18:39:00.800709 12901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:00.807260 12901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34: Bootstrap starting.
Aug 08 18:39:00 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:00.809783 12901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:00.810657 12901 log.cc:824] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:00.812779 12901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34: No bootstrap required, opened a new log
I20260808 18:39:00.813048 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:00.799718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.4.61.254:38333)
0808 18:39:00.800152 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:00.800171 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:00.800214 (+ 43us) server_negotiation.cc:407] Connection header received
0808 18:39:00.801045 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:00.801068 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:00.801480 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:00.801836 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:00.802615 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:00.804091 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:00.804992 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:00.805682 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:00.805838 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:00.808240 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:00.808248 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:00.808266 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:00.808300 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:00.810173 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:00.810597 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:00.810603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:00.810609 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:00.810746 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:00.811029 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:00.811033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:00.811034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:00.811445 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:00.811635 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:00.811861 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 18:39:00.812143 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":124,"threads_started":1}
I20260808 18:39:00.816341 12901 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } }
I20260808 18:39:00.816551 12901 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:00.816591 12901 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a93d48608a433b8f77d50a26c38d34, State: Initialized, Role: FOLLOWER
I20260808 18:39:00.817042 12901 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } }
I20260808 18:39:00.817173 12901 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:00.817219 12901 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:00.817288 12901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:00.818193 12901 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } }
I20260808 18:39:00.818548 12901 leader_election.cc:302] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71a93d48608a433b8f77d50a26c38d34; no voters:
I20260808 18:39:00.818832 12901 leader_election.cc:288] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:00.818986 12909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:00.819213 12909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [term 1 LEADER]: Becoming Leader. State: Replica: 71a93d48608a433b8f77d50a26c38d34, State: Running, Role: LEADER
I20260808 18:39:00.819561 12909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } }
I20260808 18:39:00.819968 12901 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:00.820998 12911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71a93d48608a433b8f77d50a26c38d34. Latest consensus state: current_term: 1 leader_uuid: "71a93d48608a433b8f77d50a26c38d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } } }
I20260808 18:39:00.821121 12911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:00.821449 12910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71a93d48608a433b8f77d50a26c38d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71a93d48608a433b8f77d50a26c38d34" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 38333 } } }
I20260808 18:39:00.821543 12910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:00.821658 12923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:00.824437 12923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:00.830114 12923 catalog_manager.cc:1347] Generated new cluster ID: df5cbf742df8447f9fa4cb17c99a6bb5
I20260808 18:39:00.830180 12923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:00.844893 12923 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:00.845894 12923 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:00.856665 12923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71a93d48608a433b8f77d50a26c38d34: Generated new TSK 0
I20260808 18:39:00.857542 12923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:39:00.895431 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:01.008579 12940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:01.008854 12940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:01.008914 12940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:01.012984 12940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:01.013046 12940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:01.013127 12940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:01.018401 12940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:01.019512 12940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:01.020582 12940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:01.030516 12945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:01.030560 12948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:01.030628 12940 server_base.cc:1034] running on GCE node
W20260808 18:39:01.030530 12953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:01.031172 12940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:01.031816 12940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:01.032974 12940 hybrid_clock.cc:648] HybridClock initialized: now 1786214341032957 us; error 31 us; skew 500 ppm
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.035818 12940 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:39:01.036921 12940 webserver.cc:460] Webserver started at http://127.4.61.193:45551/ using document root <none> and password file <none>
I20260808 18:39:01.037623 12940 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:01.037698 12940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:01.037914 12940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:01.040634 12940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "cebab363102d4495a35f04f569230e38"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "0b60f08c02617509da61ee4ea10cb59b"
server_key_iv: "3a702ea8b703320a01eae28ee1d24621"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.041343 12940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "cebab363102d4495a35f04f569230e38"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "0b60f08c02617509da61ee4ea10cb59b"
server_key_iv: "3a702ea8b703320a01eae28ee1d24621"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.046193 12940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 18:39:01.048759 12966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.050037 12940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:01.050168 12940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "cebab363102d4495a35f04f569230e38"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "0b60f08c02617509da61ee4ea10cb59b"
server_key_iv: "3a702ea8b703320a01eae28ee1d24621"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.050287 12940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:01.078491 12940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:01.081648 12940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:01.081861 12940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:01.082530 12940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:01.083418 12940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:01.083468 12940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.083523 12940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:01.083552 12940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.092643 12940 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:46349
I20260808 18:39:01.092684 13130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:46349 every 8 connection(s)
I20260808 18:39:01.093561 12940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:01.094214 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 12940
I20260808 18:39:01.094367 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:01.094708 4343 external_mini_cluster.cc:1428] Setting key 214adaa6284b5f23f04bc4648b269fb1
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:39:01.107522 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.095723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:55697 (local address 127.4.61.254:38333)
0808 18:39:01.095858 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.095863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.096845 (+ 982us) server_negotiation.cc:407] Connection header received
0808 18:39:01.098232 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.098235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.098290 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.098392 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.099579 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.100112 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.101249 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.101482 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.101570 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.104221 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.104224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.104226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.104249 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.105634 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.106094 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.106097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.106098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.106169 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.106488 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.106490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.106491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.106696 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.106775 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.107241 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.107363 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:01.108668 13135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.096205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:38333 (local address 127.4.61.193:55697)
0808 18:39:01.096690 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:01.096735 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:01.098026 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:01.098571 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:01.098578 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:01.098937 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:01.099432 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.099446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.100233 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.100235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.101130 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.101140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.101625 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.101629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.101798 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.102369 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:01.102386 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:01.104053 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:01.105751 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.105756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.105769 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.106016 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.106233 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.106235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.106236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.106401 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.106780 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:01.106785 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:01.107038 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 18:39:01.107218 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 18:39:01.107591 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":133,"threads_started":1}
I20260808 18:39:01.110073 13132 heartbeater.cc:347] Connected to a master server at 127.4.61.254:38333
I20260808 18:39:01.110363 13132 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:01.110905 13132 heartbeater.cc:511] Master 127.4.61.254:38333 requested a full tablet report, sending...
I20260808 18:39:01.112640 12849 ts_manager.cc:194] Registered new tserver with Master: cebab363102d4495a35f04f569230e38 (127.4.61.193:46349)
I20260808 18:39:01.113793 12849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:55697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:39:01.124861 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:01.238273 13140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:01.238564 13140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:01.238607 13140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:01.242658 13140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:01.242715 13140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:01.242774 13140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:01.248155 13140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:01.249191 13140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:01.250212 13140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:01.259865 13145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:01.259935 13147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:01.259860 13149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:01.260141 13140 server_base.cc:1034] running on GCE node
I20260808 18:39:01.260627 13140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:01.261250 13140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:01.262434 13140 hybrid_clock.cc:648] HybridClock initialized: now 1786214341262421 us; error 29 us; skew 500 ppm
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.265187 13140 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:39:01.266093 13140 webserver.cc:460] Webserver started at http://127.4.61.194:39717/ using document root <none> and password file <none>
I20260808 18:39:01.266790 13140 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:01.266866 13140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:01.267051 13140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:01.269096 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "c9ea4d1058de42099d366c0fe8dd1002"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "6f5e45ad8a25780a03d1c2c8bc28f9a2"
server_key_iv: "aefbe3e8930977735ae68669c98380e5"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.269620 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "c9ea4d1058de42099d366c0fe8dd1002"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "6f5e45ad8a25780a03d1c2c8bc28f9a2"
server_key_iv: "aefbe3e8930977735ae68669c98380e5"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.273402 13140 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:39:01.275883 13157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.277068 13140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 18:39:01.277189 13140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "c9ea4d1058de42099d366c0fe8dd1002"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "6f5e45ad8a25780a03d1c2c8bc28f9a2"
server_key_iv: "aefbe3e8930977735ae68669c98380e5"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.277287 13140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:01.292963 13140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:01.295902 13140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:01.296082 13140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:01.296640 13140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:01.297462 13140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:01.297509 13140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.297561 13140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:01.297588 13140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.305979 13140 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:33335
I20260808 18:39:01.306003 13313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:33335 every 8 connection(s)
I20260808 18:39:01.306852 13140 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:01.312275 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 13140
I20260808 18:39:01.312433 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:01.312881 4343 external_mini_cluster.cc:1428] Setting key 45746f87a00f522029fbe8e29602d388
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:01.322991 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.308535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:48329 (local address 127.4.61.254:38333)
0808 18:39:01.308655 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.308659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.309455 (+ 796us) server_negotiation.cc:407] Connection header received
0808 18:39:01.310862 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.310865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.310927 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.310999 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.312917 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.313777 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.315472 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.315709 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.315798 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.318842 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.318846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.318849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.318877 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.320652 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.321146 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.321150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.321152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.321246 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.321671 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.321674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.321676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.321922 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.322038 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.322662 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.322808 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:39:01.323644 13319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.308848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:38333 (local address 127.4.61.194:48329)
0808 18:39:01.309298 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:01.309345 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:01.310642 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:01.311180 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:01.311189 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:01.311655 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:01.312730 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.312752 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.313934 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.313939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.315360 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.315372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.315859 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.315864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.316087 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.316742 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:01.316762 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:01.318647 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:01.320764 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.320769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.320782 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.321035 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.321360 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.321364 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.321366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.321561 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.322044 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:01.322050 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:01.322382 (+ 332us) client_negotiation.cc:769] Sending connection context
0808 18:39:01.322544 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 18:39:01.322795 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:39:01.324932 13314 heartbeater.cc:347] Connected to a master server at 127.4.61.254:38333
I20260808 18:39:01.325160 13314 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:01.325688 13314 heartbeater.cc:511] Master 127.4.61.254:38333 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:39:01.326781 12849 ts_manager.cc:194] Registered new tserver with Master: c9ea4d1058de42099d366c0fe8dd1002 (127.4.61.194:33335)
I20260808 18:39:01.327366 12849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:48329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:39:01.341140 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:01.451735 13323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:01.451997 13323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:01.452039 13323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:01.456097 13323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:01.456171 13323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:01.456248 13323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:01.461526 13323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:38333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:01.462561 13323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:01.463589 13323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:01.473325 13328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:01.473330 13329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:01.473320 13332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:01.473594 13323 server_base.cc:1034] running on GCE node
I20260808 18:39:01.474107 13323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:01.474759 13323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:01.475929 13323 hybrid_clock.cc:648] HybridClock initialized: now 1786214341475910 us; error 32 us; skew 500 ppm
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.478605 13323 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:39:01.479437 13323 webserver.cc:460] Webserver started at http://127.4.61.195:46105/ using document root <none> and password file <none>
I20260808 18:39:01.479957 13323 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:01.480018 13323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:01.480183 13323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:01.482300 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "eabead342ce34b8eb8fe94b1c34d01e7"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "8f247f58900e3eff462e66e8266274bf"
server_key_iv: "f372cfa8656889492f0b8896b02fb018"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.482894 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "eabead342ce34b8eb8fe94b1c34d01e7"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "8f247f58900e3eff462e66e8266274bf"
server_key_iv: "f372cfa8656889492f0b8896b02fb018"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.486714 13323 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:39:01.489080 13342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.490381 13323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:01.490489 13323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "eabead342ce34b8eb8fe94b1c34d01e7"
format_stamp: "Formatted at 2026-08-08 18:39:01 on dist-test-slave-fgb3"
server_key: "8f247f58900e3eff462e66e8266274bf"
server_key_iv: "f372cfa8656889492f0b8896b02fb018"
server_key_version: "encryptionkey@0"
I20260808 18:39:01.490589 13323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:01.510641 13323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:01.513945 13323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:01.514153 13323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:01.514868 13323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:01.515781 13323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:01.515834 13323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.515882 13323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:01.515916 13323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:01.525570 13323 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:40939
I20260808 18:39:01.525641 13520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:40939 every 8 connection(s)
I20260808 18:39:01.526535 13323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:01.527324 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 13323
I20260808 18:39:01.527444 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:01.527717 4343 external_mini_cluster.cc:1428] Setting key a50e5572ba2414d56c044cc20c485e95
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:01.540278 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.528505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:33927 (local address 127.4.61.254:38333)
0808 18:39:01.528642 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.528647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.529634 (+ 987us) server_negotiation.cc:407] Connection header received
0808 18:39:01.531128 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.531131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.531188 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.531256 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.532358 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.532893 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.533945 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.534175 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.534256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.536475 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.536478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.536480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.536504 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.537732 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.538414 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.538418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.538420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.538517 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.538918 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.538922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.538923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.539166 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.539275 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.539956 (+ 681us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.540091 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:01.541115 13523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.528942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:38333 (local address 127.4.61.195:33927)
0808 18:39:01.529471 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:01.529529 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:01.530935 (+ 1406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:01.531413 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:01.531419 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:01.531756 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:01.532241 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.532255 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.532978 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.532980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.533839 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:01.533847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.534288 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.534292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:01.534486 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.534977 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:01.534993 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:01.536326 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:01.537848 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.537885 (+ 37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.537901 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.538274 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.538601 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:01.538605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:01.538607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:01.538786 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:01.539343 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:01.539350 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:01.539665 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 18:39:01.539865 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 18:39:01.540205 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":141,"threads_started":1}
I20260808 18:39:01.547642 13521 heartbeater.cc:347] Connected to a master server at 127.4.61.254:38333
I20260808 18:39:01.547935 13521 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:01.548521 13521 heartbeater.cc:511] Master 127.4.61.254:38333 requested a full tablet report, sending...
I20260808 18:39:01.549556 12849 ts_manager.cc:194] Registered new tserver with Master: eabead342ce34b8eb8fe94b1c34d01e7 (127.4.61.195:40939)
I20260808 18:39:01.550343 12849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:33927
I20260808 18:39:01.560803 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/test-admin.keytab.
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.581012 4343 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 18:39:01.584080 13530 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:01.582712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45736 (local address 127.4.61.193:46349)
0808 18:39:01.582986 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.583003 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.583031 (+ 28us) server_negotiation.cc:407] Connection header received
0808 18:39:01.583087 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.583092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.583281 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.583400 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.583897 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45736: BlockingRecv error: recv got EOF from 127.0.0.1:45736 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":99,"threads_started":1}
W20260808 18:39:01.584319 4343 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc)
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.585508 4343 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.586587 4343 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:39:01.597157 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.587622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45740 (local address 127.4.61.193:46349)
0808 18:39:01.587745 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.587748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.587801 (+ 53us) server_negotiation.cc:407] Connection header received
0808 18:39:01.587936 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.587939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.587979 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.588038 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.588719 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.589544 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.590792 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.591200 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.591291 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.593765 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.593777 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.593792 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.593820 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.595560 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.595980 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.595985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.595986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.596068 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.596263 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.596265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.596266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.596518 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.596673 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.596821 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.596979 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 18:39:01.601099 13530 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:01.600282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.4.61.193:46349)
0808 18:39:01.600415 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.600418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.600434 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:39:01.600552 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.600554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.600590 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.600648 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.601000 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45748: BlockingRecv error: recv got EOF from 127.0.0.1:45748 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 18:39:01.601234 4343 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc)
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.602303 4343 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.603226 4343 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:39:01.611492 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.604042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45750 (local address 127.4.61.193:46349)
0808 18:39:01.604163 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.604167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.604256 (+ 89us) server_negotiation.cc:407] Connection header received
0808 18:39:01.604394 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.604398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.604438 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.604501 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.604984 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.605497 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.606257 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.606613 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.606672 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.608797 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.608801 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.608803 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.608835 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.610000 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.610402 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.610406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.610408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.610486 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.610723 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.610727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.610729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.610905 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.611013 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.611235 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.611342 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 18:39:01.614012 13530 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:01.613110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45762 (local address 127.4.61.193:46349)
0808 18:39:01.613227 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.613231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.613327 (+ 96us) server_negotiation.cc:407] Connection header received
0808 18:39:01.613443 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.613447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.613485 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.613544 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.613913 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45762: BlockingRecv error: recv got EOF from 127.0.0.1:45762 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 18:39:01.614107 4343 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786214311986709-4343-0/krb5kdc/krb5cc' of type FILE
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.615105 4343 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:01.615892 4343 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[12776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:39:01.623847 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:01.616677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45778 (local address 127.4.61.193:46349)
0808 18:39:01.616811 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:01.616815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:01.616833 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:39:01.616943 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:01.616946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:01.616983 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:01.617044 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:01.617520 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.618014 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.618842 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:01.619047 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:01.619133 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:01.621231 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:01.621234 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:01.621236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:01.621257 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:01.622396 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.622784 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.622787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.622788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.622860 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:01.623099 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:01.623103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:01.623105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:01.623264 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:01.623378 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:01.623599 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 18:39:01.623697 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:39:01.624974 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12940
I20260808 18:39:01.638082 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 13140
I20260808 18:39:01.646374 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 13323
I20260808 18:39:01.666486 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 12797
2026-08-08T18:39:01Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2342 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[13547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[13547](info): set up 2 sockets
Aug 08 18:39:01 dist-test-slave-fgb3 krb5kdc[13547](info): commencing operation
krb5kdc: starting...
W20260808 18:39:02.801390 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:02 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:02Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab.
Entry for principal oryx/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab.
I20260808 18:39:02.926571 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45591
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab
--principal=oryx/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45591
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:03.037096 13567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:03.037359 13567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:03.037400 13567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:03.041314 13567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:03.041371 13567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:03.041389 13567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:03.041404 13567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:03.041419 13567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:03.046509 13567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab
--principal=oryx/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:03.047510 13567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:03.048471 13567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:03.056828 13576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.056821 13581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.056821 13577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:03.057040 13567 server_base.cc:1034] running on GCE node
I20260808 18:39:03.057772 13567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:03.058929 13567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:03.060086 13567 hybrid_clock.cc:648] HybridClock initialized: now 1786214343060068 us; error 31 us; skew 500 ppm
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:03.062830 13567 init.cc:377] Logged in from keytab as oryx/127.4.61.254@KRBTEST.COM (short username oryx)
I20260808 18:39:03.063756 13567 webserver.cc:460] Webserver started at http://127.4.61.254:43819/ using document root <none> and password file <none>
I20260808 18:39:03.064318 13567 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:03.064386 13567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:03.064597 13567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:03.066761 13567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "4c4cdfba4abe4a8492f81506c656c19a"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "4c18d606842e060e8b654473c5bf3b64"
server_key_iv: "13ef3e141b411fa0508df84c8b552792"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.067359 13567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "4c4cdfba4abe4a8492f81506c656c19a"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "4c18d606842e060e8b654473c5bf3b64"
server_key_iv: "13ef3e141b411fa0508df84c8b552792"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.071364 13567 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 18:39:03.073877 13594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.075213 13567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:03.075348 13567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "4c4cdfba4abe4a8492f81506c656c19a"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "4c18d606842e060e8b654473c5bf3b64"
server_key_iv: "13ef3e141b411fa0508df84c8b552792"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.075459 13567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:03.101306 13567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:03.104400 13567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:03.104597 13567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:03.111810 13567 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:45591
I20260808 18:39:03.112064 13668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:45591 every 8 connection(s)
I20260808 18:39:03.112849 13567 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:03.113034 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 13567
I20260808 18:39:03.113180 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:03.113566 4343 external_mini_cluster.cc:1428] Setting key 6632fc2cae042c24a14f6e59ef95114e
I20260808 18:39:03.115962 13670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:03.122414 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Bootstrap starting.
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:03.124719 13670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:03.125420 13670 log.cc:824] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:03.127313 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: No bootstrap required, opened a new log
I20260808 18:39:03.128005 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.114970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.4.61.254:45591)
0808 18:39:03.115384 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:03.115400 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:03.115439 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:39:03.116095 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:03.116120 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:03.116462 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:03.116748 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:03.117638 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.118787 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.119932 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.120412 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.120534 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.123378 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:03.123383 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:03.123396 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:03.123424 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:03.125079 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.125535 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.125543 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.125549 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.125678 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.125965 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.125969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.125971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.126444 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:03.126645 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:03.126964 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 18:39:03.127260 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":120,"threads_started":1}
I20260808 18:39:03.131093 13670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } }
I20260808 18:39:03.131321 13670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:03.131381 13670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4cdfba4abe4a8492f81506c656c19a, State: Initialized, Role: FOLLOWER
I20260808 18:39:03.131789 13670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } }
I20260808 18:39:03.131923 13670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:03.131989 13670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:03.132086 13670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:03.132915 13670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } }
I20260808 18:39:03.133255 13670 leader_election.cc:302] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c4cdfba4abe4a8492f81506c656c19a; no voters:
I20260808 18:39:03.133576 13670 leader_election.cc:288] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:03.133656 13677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:03.133837 13677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 LEADER]: Becoming Leader. State: Replica: 4c4cdfba4abe4a8492f81506c656c19a, State: Running, Role: LEADER
I20260808 18:39:03.134123 13677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } }
I20260808 18:39:03.134845 13670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:03.135811 13678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c4cdfba4abe4a8492f81506c656c19a. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } }
I20260808 18:39:03.135942 13678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:03.136219 13679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } }
I20260808 18:39:03.136309 13679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:03.136330 13692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:03.139119 13692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:03.144444 13692 catalog_manager.cc:1347] Generated new cluster ID: 6d27ab38df7847c6b8f875c08988de51
I20260808 18:39:03.144507 13692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:03.149430 13692 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:03.150291 13692 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:03.159889 13692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Generated new TSK 0
I20260808 18:39:03.160584 13692 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
I20260808 18:39:03.197094 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:03.311524 13711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:03.311888 13711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:03.311955 13711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:03.317680 13711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:03.317777 13711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:03.317875 13711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:03.323781 13711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:03.324853 13711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:03.325889 13711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:03.335600 13717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.335606 13716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.335608 13721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:03.336110 13711 server_base.cc:1034] running on GCE node
I20260808 18:39:03.336542 13711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:03.337198 13711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:03.338387 13711 hybrid_clock.cc:648] HybridClock initialized: now 1786214343338359 us; error 41 us; skew 500 ppm
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:03.348676 13711 init.cc:377] Logged in from keytab as oryx/127.4.61.193@KRBTEST.COM (short username oryx)
I20260808 18:39:03.349677 13711 webserver.cc:460] Webserver started at http://127.4.61.193:40405/ using document root <none> and password file <none>
I20260808 18:39:03.350257 13711 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:03.350359 13711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:03.350596 13711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:03.352705 13711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "2608011434474099afa9bb739d425c33"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "cb2074cbc1fd56a61084492477af42c8"
server_key_iv: "5d6173d9282b609a95290b4e52f5df63"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.353257 13711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "2608011434474099afa9bb739d425c33"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "cb2074cbc1fd56a61084492477af42c8"
server_key_iv: "5d6173d9282b609a95290b4e52f5df63"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.357064 13711 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:39:03.359664 13730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.360954 13711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:03.361073 13711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "2608011434474099afa9bb739d425c33"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "cb2074cbc1fd56a61084492477af42c8"
server_key_iv: "5d6173d9282b609a95290b4e52f5df63"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.361178 13711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:03.401902 13711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:03.404721 13711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:03.404906 13711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:03.405511 13711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:03.406371 13711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:03.406418 13711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.406473 13711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:03.406502 13711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.414983 13711 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:38951
I20260808 18:39:03.415014 13899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:38951 every 8 connection(s)
I20260808 18:39:03.415838 13711 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:03.424775 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 13711
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:03.424891 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:03.425184 4343 external_mini_cluster.cc:1428] Setting key e10a5ee1ebd77c8c3aae630e5d8568e2
I20260808 18:39:03.428985 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.417568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51013 (local address 127.4.61.254:45591)
0808 18:39:03.417701 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:03.417705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:03.418831 (+ 1126us) server_negotiation.cc:407] Connection header received
0808 18:39:03.419715 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:03.419719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:03.419784 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:03.419859 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:03.420995 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.421536 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.422690 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.422936 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.423023 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.425466 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:03.425470 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:03.425472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:03.425508 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:03.427005 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.427497 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.427501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.427503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.427592 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.427873 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.427876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.427878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.428075 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:03.428168 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:03.428677 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 18:39:03.428821 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:39:03.429803 13902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.417977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:51013)
0808 18:39:03.418672 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:03.418712 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:03.419507 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:03.420035 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:03.420041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:03.420387 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:03.420847 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.420862 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.421655 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.421658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.422571 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.422581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.423077 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.423081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.423253 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.423755 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:03.423770 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:03.425294 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:03.427113 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.427118 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.427130 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.427403 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.427670 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.427672 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.427674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.427800 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.428178 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:03.428183 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:03.428438 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 18:39:03.428612 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 18:39:03.428937 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":122,"threads_started":1}
I20260808 18:39:03.430943 13900 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:03.431195 13900 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:03.431782 13900 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
I20260808 18:39:03.433502 13623 ts_manager.cc:194] Registered new tserver with Master: 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:03.434749 13623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:51013
WARNING: no policy specified for oryx/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
I20260808 18:39:03.453636 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:03.564783 13905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:03.565030 13905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:03.565088 13905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:03.569440 13905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:03.569502 13905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:03.569559 13905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:03.574714 13905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:03.575718 13905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:03.576689 13905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:03.586017 13915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:03.586165 13905 server_base.cc:1034] running on GCE node
W20260808 18:39:03.586024 13914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.586024 13918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:03.586768 13905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:03.587337 13905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:03.588505 13905 hybrid_clock.cc:648] HybridClock initialized: now 1786214343588472 us; error 46 us; skew 500 ppm
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:03.591277 13905 init.cc:377] Logged in from keytab as oryx/127.4.61.194@KRBTEST.COM (short username oryx)
I20260808 18:39:03.592135 13905 webserver.cc:460] Webserver started at http://127.4.61.194:34787/ using document root <none> and password file <none>
I20260808 18:39:03.592680 13905 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:03.592746 13905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:03.592931 13905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:03.594957 13905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "8a1c03ab56ee9b1fec319177599677ec"
server_key_iv: "7b4b348f6e1829c81c10af07863e251d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.595559 13905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "8a1c03ab56ee9b1fec319177599677ec"
server_key_iv: "7b4b348f6e1829c81c10af07863e251d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.599306 13905 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:39:03.601593 13925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.602861 13905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:03.602972 13905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "8a1c03ab56ee9b1fec319177599677ec"
server_key_iv: "7b4b348f6e1829c81c10af07863e251d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.603062 13905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:03.640859 13905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:03.643920 13905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:03.644096 13905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:03.644665 13905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:03.645496 13905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:03.645542 13905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.645586 13905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:03.645614 13905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.653859 13905 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:46745
I20260808 18:39:03.653920 14085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:46745 every 8 connection(s)
I20260808 18:39:03.654795 13905 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:03.660960 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 13905
I20260808 18:39:03.661080 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:03.661402 4343 external_mini_cluster.cc:1428] Setting key a03629817cc4b135c61bbb5d73bc5dc6
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:03.669070 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.656661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:42151 (local address 127.4.61.254:45591)
0808 18:39:03.656817 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:03.656822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:03.657859 (+ 1037us) server_negotiation.cc:407] Connection header received
0808 18:39:03.658813 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:03.658816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:03.658865 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:03.658927 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:03.660214 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.660735 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.662154 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.662484 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.662580 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.665300 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:03.665305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:03.665308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:03.665360 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:03.666806 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.667388 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.667393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.667395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.667485 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.667815 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.667819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.667821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.668072 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:03.668186 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:03.668748 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 18:39:03.668888 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:03.669898 14092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.657054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:42151)
0808 18:39:03.657715 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:03.657758 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:03.658596 (+ 838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:03.659085 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:03.659091 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:03.659517 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:03.660049 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.660069 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.660854 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.660857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.662039 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.662049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.662629 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.662633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.662814 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.663390 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:03.663410 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:03.665119 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:03.666929 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.666934 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.666946 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.667279 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.667569 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.667571 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.667572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.667712 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.668222 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:03.668230 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:03.668490 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 18:39:03.668670 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 18:39:03.668971 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":115,"threads_started":1}
I20260808 18:39:03.671168 14087 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:03.671474 14087 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:03.672137 14087 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:39:03.673399 13623 ts_manager.cc:194] Registered new tserver with Master: 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745)
I20260808 18:39:03.674000 13623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:42151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
I20260808 18:39:03.691179 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:03.801940 14095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:03.802205 14095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:03.802249 14095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:03.806252 14095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:03.806332 14095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:03.806416 14095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:03.811600 14095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:03.812601 14095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:03.813596 14095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:03.823093 14102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.823058 14101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:03.823089 14105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:03.823490 14095 server_base.cc:1034] running on GCE node
I20260808 18:39:03.823837 14095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:03.824446 14095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:03.825609 14095 hybrid_clock.cc:648] HybridClock initialized: now 1786214343825592 us; error 29 us; skew 500 ppm
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:03.828516 14095 init.cc:377] Logged in from keytab as oryx/127.4.61.195@KRBTEST.COM (short username oryx)
I20260808 18:39:03.829397 14095 webserver.cc:460] Webserver started at http://127.4.61.195:46623/ using document root <none> and password file <none>
I20260808 18:39:03.830013 14095 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:03.830093 14095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:03.830305 14095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:03.832425 14095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "512cf31132ca4e2299f3c2864bb53dd6"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "d1bb73b76b1fae9e4c30b5e5ab5f7be3"
server_key_iv: "e69c4936c1869b58aaa29ab7bb5a787d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.832980 14095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "512cf31132ca4e2299f3c2864bb53dd6"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "d1bb73b76b1fae9e4c30b5e5ab5f7be3"
server_key_iv: "e69c4936c1869b58aaa29ab7bb5a787d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.836863 14095 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:39:03.839417 14114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.840715 14095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:03.840831 14095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "512cf31132ca4e2299f3c2864bb53dd6"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "d1bb73b76b1fae9e4c30b5e5ab5f7be3"
server_key_iv: "e69c4936c1869b58aaa29ab7bb5a787d"
server_key_version: "encryptionkey@0"
I20260808 18:39:03.840947 14095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:03.855988 14095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:03.859015 14095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:03.859220 14095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:03.859846 14095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:03.860707 14095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:03.860756 14095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.860810 14095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:03.860838 14095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:03.869299 14095 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:36749
I20260808 18:39:03.869330 14265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:36749 every 8 connection(s)
I20260808 18:39:03.870182 14095 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:03.878196 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 14095
I20260808 18:39:03.878392 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:03.878782 4343 external_mini_cluster.cc:1428] Setting key fb91599d413584b4661a9fcf817551c9
Aug 08 18:39:03 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:03.883642 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.872331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47803 (local address 127.4.61.254:45591)
0808 18:39:03.872467 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:03.872470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:03.873275 (+ 805us) server_negotiation.cc:407] Connection header received
0808 18:39:03.874567 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:03.874570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:03.874628 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:03.874698 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:03.875886 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.876417 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.877554 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.877768 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.877852 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.880469 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:03.880473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:03.880476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:03.880505 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:03.881787 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.882227 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.882229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.882230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.882298 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:03.882594 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:03.882597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:03.882598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:03.882772 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:03.882846 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:03.883422 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 18:39:03.883522 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:03.884472 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:03.872675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:47803)
0808 18:39:03.873128 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:03.873170 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:03.874347 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:03.874884 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:03.874891 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:03.875246 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:03.875749 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.875763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.876533 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.876536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.877440 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:03.877450 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:03.877905 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:03.877910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:03.878086 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:03.878692 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:03.878713 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:03.880321 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:03.881885 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.881889 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.881901 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.882152 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.882387 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:03.882389 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:03.882391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:03.882524 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:03.882896 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:03.882902 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:03.883169 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 18:39:03.883382 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 18:39:03.883653 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":111,"threads_started":1}
I20260808 18:39:03.885526 14266 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:03.885756 14266 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:03.886234 14266 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
I20260808 18:39:03.887259 13623 ts_manager.cc:194] Registered new tserver with Master: 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749)
I20260808 18:39:03.887812 13623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:47803
I20260808 18:39:03.892519 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.61.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.253.keytab.
Entry for principal oryx/127.4.61.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.253.keytab.
I20260808 18:39:03.919411 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:41157
--webserver_interface=127.4.61.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.253.keytab
--principal=oryx/127.4.61.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45591,127.4.61.253:41157
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:04.033002 14273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:04.033290 14273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:04.033350 14273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:04.037484 14273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:04.037549 14273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:04.037576 14273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:04.037598 14273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:04.037623 14273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:04.043135 14273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45591,127.4.61.253:41157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.253.keytab
--principal=oryx/127.4.61.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:41157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.61.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
W20260808 18:39:04.043402 14273 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.4.61.254:45591,127.4.61.253:41157'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 18:39:04.044386 14273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:04.045486 14273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:04.053853 14278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.053911 14281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.053921 14279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.053972 14273 server_base.cc:1034] running on GCE node
I20260808 18:39:04.054661 14273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.055753 14273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.056934 14273 hybrid_clock.cc:648] HybridClock initialized: now 1786214344056907 us; error 36 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.059758 14273 init.cc:377] Logged in from keytab as oryx/127.4.61.253@KRBTEST.COM (short username oryx)
I20260808 18:39:04.060648 14273 webserver.cc:460] Webserver started at http://127.4.61.253:44041/ using document root <none> and password file <none>
I20260808 18:39:04.061165 14273 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.061223 14273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.061394 14273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:04.063412 14273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/instance:
uuid: "74e053c0634c47969d6e632cfa55b359"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "eb88d2217f856b1ea0fcbef590b91b2f"
server_key_iv: "afd63ed3bbe66b89f9a2b37cb5df3465"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.063916 14273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal/instance:
uuid: "74e053c0634c47969d6e632cfa55b359"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "eb88d2217f856b1ea0fcbef590b91b2f"
server_key_iv: "afd63ed3bbe66b89f9a2b37cb5df3465"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.067567 14273 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:39:04.070037 14295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.071413 14273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:39:04.071527 14273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "74e053c0634c47969d6e632cfa55b359"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "eb88d2217f856b1ea0fcbef590b91b2f"
server_key_iv: "afd63ed3bbe66b89f9a2b37cb5df3465"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.071642 14273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.082695 14273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.085299 14273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:04.085467 14273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.092038 14273 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.253:41157
I20260808 18:39:04.092337 14372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.253:41157 every 8 connection(s)
I20260808 18:39:04.093007 14273 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
I20260808 18:39:04.096036 14374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:04.096537 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 14273
I20260808 18:39:04.101329 14374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.253@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:04.112452 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.098206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58036 (local address 127.4.61.253:41157)
0808 18:39:04.098733 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.098754 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.098799 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:39:04.099575 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.099602 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.100037 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.100417 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.101064 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.102570 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.103672 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.104336 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.104503 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.107223 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.107230 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.107242 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.107276 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.109170 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.109585 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.109592 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.109598 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.109732 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.110033 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.110037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.110039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.110579 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.110807 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.111090 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.111411 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":133,"threads_started":1}
I20260808 18:39:04.114154 14381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.103262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50188)
0808 18:39:04.103635 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.103688 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.103816 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.104083 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.104089 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.104564 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.104728 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.104738 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.105806 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.105809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.106565 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.106576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.107223 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.107227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.107336 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.107943 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.107960 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.109529 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.111449 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.111457 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.111463 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.111755 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.112044 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.112047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.112049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.112149 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.113510 (+ 1361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.113516 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.113643 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.113792 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.113986 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":91,"threads_started":1}
I20260808 18:39:04.114195 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.103339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50188 (local address 127.4.61.254:45591)
0808 18:39:04.103464 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.103470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.103782 (+ 312us) server_negotiation.cc:407] Connection header received
0808 18:39:04.103906 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.103908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.103953 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.104015 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.104885 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.105662 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.106769 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.106998 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.107062 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.109660 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.109663 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.109665 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.109690 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.111365 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.111861 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.111865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.111866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.111952 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.112254 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.112258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.112260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.112509 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.112596 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.113896 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.114030 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:39:04.115497 14374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.253@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
I20260808 18:39:04.123675 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.116071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58050 (local address 127.4.61.253:41157)
0808 18:39:04.116164 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.116169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.116181 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:04.116279 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.116282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.116321 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.116386 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.116754 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.117573 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.118350 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.118585 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.118681 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.120829 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.120832 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.120834 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.120855 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.122103 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.122551 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.122553 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.122554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.122623 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.122855 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.122857 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.122858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.123074 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.123147 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.123379 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.123525 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":43}
I20260808 18:39:04.123677 14381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.115998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58050)
0808 18:39:04.116097 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.116112 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.116192 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.116418 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.116421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.116564 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.116649 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.116655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.117708 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.117711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.118222 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.118230 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.118687 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.118691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.118790 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.119283 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.119296 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.120703 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.122201 (+ 1498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.122204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.122206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.122466 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.122697 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.122700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.122702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.122784 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.123148 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.123150 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.123246 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.123348 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.123475 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 18:39:04.126436 14374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Bootstrap starting.
I20260808 18:39:04.128614 14374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:04.129297 14374 log.cc:824] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:04.131251 14374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: No bootstrap required, opened a new log
I20260808 18:39:04.134107 14374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } }
I20260808 18:39:04.134305 14374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:04.134385 14374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74e053c0634c47969d6e632cfa55b359, State: Initialized, Role: FOLLOWER
I20260808 18:39:04.134831 14374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } }
I20260808 18:39:04.135309 14383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } } }
I20260808 18:39:04.135429 14383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:04.136062 14374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 18:39:04.140698 14398 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:39:04.140782 14398 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:39:04.141140 14383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:04.141278 14383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } }
I20260808 18:39:04.142030 14383 leader_election.cc:288] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591)
I20260808 18:39:04.142475 13635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "74e053c0634c47969d6e632cfa55b359" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4cdfba4abe4a8492f81506c656c19a" is_pre_election: true
I20260808 18:39:04.143038 14303 leader_election.cc:302] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 74e053c0634c47969d6e632cfa55b359; no voters: 4c4cdfba4abe4a8492f81506c656c19a
I20260808 18:39:04.143221 14273 master_runner.cc:428] Detected that this master 74e053c0634c47969d6e632cfa55b359 is joining an existing cluster
I20260808 18:39:04.143268 14273 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.61.253:41157
I20260808 18:39:04.143289 14383 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 18:39:04.153044 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.145633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58062 (local address 127.4.61.253:41157)
0808 18:39:04.145741 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.145746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.145759 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:04.145793 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.145797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.145846 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.145927 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.146439 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.147215 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148320 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.148671 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148771 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.149929 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.149932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.149935 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.149959 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.151450 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.151895 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.151900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.151901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.151991 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152260 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.152271 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.152273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.152469 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.152552 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.152771 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.152913 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":47}
I20260808 18:39:04.153056 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.145231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58062)
0808 18:39:04.145529 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.145543 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.145633 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.145963 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.145967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.146183 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.146309 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.146354 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.147335 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.147338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.148204 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.148214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.148797 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.148888 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.149387 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.149399 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.149777 (+ 378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.151557 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.151560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.151562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.151781 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.152081 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152084 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.152086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.152173 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.152549 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.152551 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.152633 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.152717 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.152859 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":110,"threads_started":1}
I20260808 18:39:04.154388 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.145878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50192)
0808 18:39:04.146169 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.146181 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.146273 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.146541 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.146544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.146734 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.146830 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.146835 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.147689 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.147693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.148500 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.148509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.148985 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.149395 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.149882 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.149896 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.150302 (+ 406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.152129 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152131 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.152133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.152337 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.152631 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.152636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.152720 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.153368 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.153371 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.153469 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.154055 (+ 586us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.154186 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":107,"threads_started":1}
I20260808 18:39:04.154443 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.145745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50192 (local address 127.4.61.254:45591)
0808 18:39:04.145865 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.145869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.146272 (+ 403us) server_negotiation.cc:407] Connection header received
0808 18:39:04.146405 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.146408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.146456 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.146517 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.146940 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.147563 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148602 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.148880 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.148976 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.150684 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.150688 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.150690 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.150718 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.152028 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152435 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.152439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.152441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.152527 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.152828 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.152831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.152833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.153035 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.153293 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.154130 (+ 837us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.154245 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.254@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
I20260808 18:39:04.168397 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.158986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58078)
0808 18:39:04.159356 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.159415 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.159547 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.159824 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.159830 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.160304 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.160440 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.160449 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.161137 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.161141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.162135 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.162147 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.162608 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.162612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.162735 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.163194 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.163208 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.164780 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.166424 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.166433 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.166440 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.166732 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.167088 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.167091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.167093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.167184 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.167703 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.167711 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.167852 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.168005 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.168209 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
I20260808 18:39:04.168390 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.159027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.4.61.253:41157)
0808 18:39:04.159140 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.159145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.159492 (+ 347us) server_negotiation.cc:407] Connection header received
0808 18:39:04.159664 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.159666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.159710 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.159774 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.160560 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.161045 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.162253 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.162512 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.162590 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.164904 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.164907 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.164909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.164931 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.166280 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.166862 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.166866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.166868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.166980 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.167324 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.167328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.167330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.167589 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.167686 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.168090 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.168218 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:39:04.170364 13623 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.61.253:41157: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "74e053c0634c47969d6e632cfa55b359"
member_type: NON_VOTER
last_known_addr {
host: "127.4.61.253"
port: 41157
}
attrs {
promote: true
}
}
dest_uuid: "4c4cdfba4abe4a8492f81506c656c19a"
cas_config_opid_index: -1
I20260808 18:39:04.171150 13623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } }
I20260808 18:39:04.173113 14417 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 74e053c0634c47969d6e632cfa55b359 (127.4.61.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } }
I20260808 18:39:04.173779 14338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:04.175309 14417 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.61.253:41157
I20260808 18:39:04.175649 14338 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 18:39:04.175770 14273 master.cc:537] Master@127.4.61.253:41157 shutting down...
I20260808 18:39:04.175694 14417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } }
I20260808 18:39:04.176106 14417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:04.176354 14417 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.4.61.252@KRBTEST.COM; defaulting to no policy
W20260808 18:39:04.178407 13597 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.252@KRBTEST.COM" created.
W20260808 18:39:04.179590 13597 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a -> Peer 74e053c0634c47969d6e632cfa55b359 (127.4.61.253:41157): Couldn't send request to peer 74e053c0634c47969d6e632cfa55b359. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 18:39:04.182888 14273 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:04.183152 14273 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:04.183276 14273 tablet_replica.cc:330] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: stopping tablet replica
I20260808 18:39:04.198599 14273 master.cc:552] Master@127.4.61.253:41157 shutdown complete.
I20260808 18:39:04.198647 14273 master_runner.cc:305] Clearing existing system tablet
I20260808 18:39:04.198908 14273 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.198957 14273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.200569 14273 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.201356 14428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.201539 14273 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.201661 14273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.201700 14273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "74e053c0634c47969d6e632cfa55b359"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "eb88d2217f856b1ea0fcbef590b91b2f"
server_key_iv: "afd63ed3bbe66b89f9a2b37cb5df3465"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.252.keytab.
Entry for principal oryx/127.4.61.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.252.keytab.
I20260808 18:39:04.203323 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:45237
--webserver_interface=127.4.61.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.252.keytab
--principal=oryx/127.4.61.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:39:04.203742 14273 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:04.205798 14273 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 18:39:04.205895 14273 log.cc:1196] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 18:39:04.206153 14273 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Deleting consensus metadata
I20260808 18:39:04.206414 14273 master_runner.cc:315] Copying system tablet from 127.4.61.254:45591
I20260808 18:39:04.207728 14273 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: tablet copy: Beginning tablet copy session from remote peer at address 127.4.61.254:45591
I20260808 18:39:04.222803 14440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.210711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50208)
0808 18:39:04.214529 (+ 3818us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.214546 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.214695 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.214993 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.214996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.215226 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.215361 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.215370 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.216425 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.216429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.217369 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.217380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.217949 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.217963 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.218062 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.218745 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.218760 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.219176 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.221256 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.221260 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.221262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.221504 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.221762 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.221765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.221767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.221864 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.222246 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.222249 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.222381 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.222486 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.222621 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3730,"thread_start_us":98,"threads_started":1}
I20260808 18:39:04.222836 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.210802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.4.61.254:45591)
0808 18:39:04.210947 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.210951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.214663 (+ 3712us) server_negotiation.cc:407] Connection header received
0808 18:39:04.214821 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.214825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.214886 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.214966 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.215481 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.216317 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.217484 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.217833 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.217936 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.219344 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.219349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.219351 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.219380 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.221146 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.221591 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.221595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.221596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.221678 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.221947 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.221951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.221953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.222159 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.222248 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.222557 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.222671 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:39:04.223978 13649 tablet_copy_service.cc:140] P 4c4cdfba4abe4a8492f81506c656c19a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 74e053c0634c47969d6e632cfa55b359 ({username='oryx', principal='oryx/127.4.61.253@KRBTEST.COM'} at 127.0.0.1:50208)
I20260808 18:39:04.224144 13649 tablet_copy_service.cc:161] P 4c4cdfba4abe4a8492f81506c656c19a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 74e053c0634c47969d6e632cfa55b359 at {username='oryx', principal='oryx/127.4.61.253@KRBTEST.COM'} at 127.0.0.1:50208: session id = 74e053c0634c47969d6e632cfa55b359-00000000000000000000000000000000
I20260808 18:39:04.226224 13649 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 18:39:04.228212 14273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 18:39:04.230746 14273 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: tablet copy: Starting download of 0 data blocks...
I20260808 18:39:04.230953 14273 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: tablet copy: Starting download of 1 WAL segments...
I20260808 18:39:04.232878 14273 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 18:39:04.234722 13649 tablet_copy_service.cc:342] P 4c4cdfba4abe4a8492f81506c656c19a: Request end of tablet copy session 74e053c0634c47969d6e632cfa55b359-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.61.253@KRBTEST.COM'} at 127.0.0.1:50208
I20260808 18:39:04.234826 13649 tablet_copy_service.cc:433] P 4c4cdfba4abe4a8492f81506c656c19a: ending tablet copy session 74e053c0634c47969d6e632cfa55b359-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 74e053c0634c47969d6e632cfa55b359
I20260808 18:39:04.242046 14273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:04.243878 14441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.243913 14442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.247229 14445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.247433 14273 server_base.cc:1034] running on GCE node
I20260808 18:39:04.247614 14273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.247946 14273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.249089 14273 hybrid_clock.cc:648] HybridClock initialized: now 1786214344249077 us; error 29 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.250744 14273 init.cc:377] Logged in from keytab as oryx/127.4.61.253@KRBTEST.COM (short username oryx)
I20260808 18:39:04.251240 14273 webserver.cc:460] Webserver started at http://127.4.61.253:40299/ using document root <none> and password file <none>
I20260808 18:39:04.251432 14273 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.251477 14273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.252815 14273 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.253813 14453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.254096 14273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.254174 14273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "74e053c0634c47969d6e632cfa55b359"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "eb88d2217f856b1ea0fcbef590b91b2f"
server_key_iv: "afd63ed3bbe66b89f9a2b37cb5df3465"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.254258 14273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.282975 14273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.285099 14273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.291251 14273 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.253:41157
I20260808 18:39:04.291730 14544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.253:41157 every 8 connection(s)
I20260808 18:39:04.291935 14273 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
I20260808 18:39:04.294018 14545 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:39:04.295451 14545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Bootstrap starting.
I20260808 18:39:04.307456 14545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:39:04.307803 14545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: Bootstrap complete.
I20260808 18:39:04.308482 14545 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } }
I20260808 18:39:04.308638 14545 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74e053c0634c47969d6e632cfa55b359, State: Initialized, Role: LEARNER
I20260808 18:39:04.308777 14545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } }
I20260808 18:39:04.309139 14549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } }
I20260808 18:39:04.309247 14549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: LEARNER
I20260808 18:39:04.309311 14545 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:04.312409 14565 catalog_manager.cc:1259] Loaded cluster ID: 6d27ab38df7847c6b8f875c08988de51
I20260808 18:39:04.312460 14565 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: loading cluster ID for follower catalog manager: success
I20260808 18:39:04.314031 14565 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: acquiring CA information for follower catalog manager: success
I20260808 18:39:04.315145 14565 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 18:39:04.335289 14429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:04.335615 14429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:04.335672 14429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:04.339847 14429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:04.339913 14429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:04.339931 14429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:04.339947 14429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:04.339962 14429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:04.345386 14429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.252.keytab
--principal=oryx/127.4.61.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.61.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:04.346493 14429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:04.347477 14429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:04.355731 14574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.355738 14571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.355753 14572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.355960 14429 server_base.cc:1034] running on GCE node
I20260808 18:39:04.356493 14429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.357579 14429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.358744 14429 hybrid_clock.cc:648] HybridClock initialized: now 1786214344358708 us; error 63 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.361418 14429 init.cc:377] Logged in from keytab as oryx/127.4.61.252@KRBTEST.COM (short username oryx)
I20260808 18:39:04.362613 14429 webserver.cc:460] Webserver started at http://127.4.61.252:40501/ using document root <none> and password file <none>
I20260808 18:39:04.363168 14429 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.363238 14429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.363446 14429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:04.365530 14429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/instance:
uuid: "4f1169a67c834e209fb0193eff82483d"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "e5ad6de451fa21b7b6e8d2ab6f02827a"
server_key_iv: "3f6d06c9239adc6f8722a95b71b0ab5b"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.366074 14429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal/instance:
uuid: "4f1169a67c834e209fb0193eff82483d"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "e5ad6de451fa21b7b6e8d2ab6f02827a"
server_key_iv: "3f6d06c9239adc6f8722a95b71b0ab5b"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.370059 14429 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 18:39:04.372543 14582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.373739 14429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:39:04.373869 14429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "4f1169a67c834e209fb0193eff82483d"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "e5ad6de451fa21b7b6e8d2ab6f02827a"
server_key_iv: "3f6d06c9239adc6f8722a95b71b0ab5b"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.373965 14429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.385849 14429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.388700 14429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:04.388882 14429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.399277 14429 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.252:45237
I20260808 18:39:04.399559 14654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.252:45237 every 8 connection(s)
I20260808 18:39:04.400272 14429 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
I20260808 18:39:04.401135 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 14429
I20260808 18:39:04.403789 14655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:04.408116 14655 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.252@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:04.416625 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.402738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56132 (local address 127.4.61.252:45237)
0808 18:39:04.403175 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.403190 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.403228 (+ 38us) server_negotiation.cc:407] Connection header received
0808 18:39:04.403947 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.403971 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.404395 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.404848 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.405736 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.406879 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.408034 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.408528 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.408654 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.411732 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.411737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.411746 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.411774 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.413407 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.413825 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.413830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.413835 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.413950 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.414236 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.414240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.414241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.414849 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.415082 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.415355 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.415666 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":137,"threads_started":1}
I20260808 18:39:04.419906 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.410200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50216)
0808 18:39:04.410660 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.410718 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.411075 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.411386 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.411393 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.411808 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.411943 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.411950 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.412699 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.412702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.413364 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.413373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.413807 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.413811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.413928 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.414407 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.414422 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.416075 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.418181 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.418188 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.418193 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.418500 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.418794 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.418797 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.418799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.418901 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.419426 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.419431 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.419525 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.419625 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.419758 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":166,"threads_started":1}
I20260808 18:39:04.419951 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.410457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50216 (local address 127.4.61.254:45591)
0808 18:39:04.410583 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.410587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.411005 (+ 418us) server_negotiation.cc:407] Connection header received
0808 18:39:04.411170 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.411174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.411232 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.411302 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.412076 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.412594 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.413484 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.413704 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.413802 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.416229 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.416233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.416236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.416267 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.418071 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.418596 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.418599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.418601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.418689 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.419019 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.419023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.419025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.419230 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.419337 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.419725 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.419826 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:39:04.421239 14655 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.252@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
I20260808 18:39:04.429560 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.421684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58088)
0808 18:39:04.421825 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.421842 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.421913 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.422623 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.422626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.422783 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.422868 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.422874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.423752 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.423755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.424309 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.424317 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.424837 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.424841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.424941 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.425361 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.425373 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.426554 (+ 1181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.428222 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.428226 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.428228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.428410 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.428663 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.428666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.428668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.428751 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.429096 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.429100 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.429187 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.429271 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.429399 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 18:39:04.429593 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.421853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.4.61.253:41157)
0808 18:39:04.422228 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.422231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.422244 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:04.422283 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.422286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.422356 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.422597 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.422983 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.423643 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.424477 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.424729 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.424823 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.426699 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.426702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.426704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.426734 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.428109 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.428500 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.428503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.428504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.428581 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.428830 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.428833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.428835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.429009 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.429091 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.429334 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.429449 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":195,"threads_started":1}
I20260808 18:39:04.430764 14655 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.252@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
I20260808 18:39:04.437222 13900 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
I20260808 18:39:04.438769 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.431332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.4.61.252:45237)
0808 18:39:04.431475 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.431479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.431494 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:39:04.431529 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.431532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.431571 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.431643 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.432008 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.432962 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.433684 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.433909 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.433992 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.435876 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.435880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.435883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.435905 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.437022 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.437510 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.437514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.437515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.437601 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.437907 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.437910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.437913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.438104 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.438211 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.438498 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.438642 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":57}
I20260808 18:39:04.438782 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.431293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56140)
0808 18:39:04.431386 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.431399 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.431468 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.431669 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.431672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.431825 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.431908 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.431914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.433074 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.433089 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.433586 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.433593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.434003 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.434006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.434099 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.434542 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.434555 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.435743 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.437159 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.437162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.437163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.437424 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.437685 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.437688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.437690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.437808 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.438200 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.438204 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.438293 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.438436 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.438585 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":1}
I20260808 18:39:04.441936 14655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Bootstrap starting.
I20260808 18:39:04.444275 14655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:04.445008 14655 log.cc:824] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:04.446894 14655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: No bootstrap required, opened a new log
I20260808 18:39:04.449826 14655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } }
I20260808 18:39:04.450033 14655 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:04.450069 14655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1169a67c834e209fb0193eff82483d, State: Initialized, Role: FOLLOWER
I20260808 18:39:04.450568 14655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } }
I20260808 18:39:04.451061 14665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } } }
I20260808 18:39:04.451201 14665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:04.451795 14655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: configured and running, proceeding with master startup.
W20260808 18:39:04.456967 14683 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:39:04.457051 14683 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:39:04.460317 14429 master_runner.cc:428] Detected that this master 4f1169a67c834e209fb0193eff82483d is joining an existing cluster
I20260808 18:39:04.460381 14429 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.61.252:45237
I20260808 18:39:04.470661 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 13711
I20260808 18:39:04.502377 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56146 (local address 127.4.61.252:45237)
0808 18:39:04.463414 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.463419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.463693 (+ 274us) server_negotiation.cc:407] Connection header received
0808 18:39:04.463859 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.463862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.463897 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.463939 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.464682 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465482 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467249 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467648 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467804 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.468967 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.468970 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.468972 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.468994 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.470651 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.501064 (+ 30413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.501068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.501070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.501155 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.501416 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.501419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.501421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.501641 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.501706 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.502005 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.502147 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":461,"spinlock_wait_cycles":1408}
I20260808 18:39:04.502919 14692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56146)
0808 18:39:04.463425 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.463438 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.463768 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.464082 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.464084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.464424 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.464566 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.464575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465628 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.465631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.467127 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.467138 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467794 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.467882 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.468349 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.468363 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.468839 (+ 476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.470760 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.470764 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.470766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.500909 (+ 30143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.501255 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.501258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.501260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.501337 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.501771 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.501774 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.501857 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.502603 (+ 746us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.502757 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":90,"threads_started":1}
I20260808 18:39:04.507928 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50224 (local address 127.4.61.254:45591)
0808 18:39:04.462926 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.462930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.464086 (+ 1156us) server_negotiation.cc:407] Connection header received
0808 18:39:04.464271 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.464276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.464341 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.464414 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.465028 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465789 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.466865 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467178 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467248 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.503541 (+ 36293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.503546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.503549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.503586 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.505987 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506585 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.506589 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.506591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.506679 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506982 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.506985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.506987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.507219 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.507299 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.507627 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.507767 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:39:04.508481 14689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50224)
0808 18:39:04.463926 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.463939 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.464149 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.464528 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.464530 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.464757 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.464899 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.464906 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465937 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.465939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.466756 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.466764 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467421 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.467815 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.501650 (+ 33835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.501667 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.503321 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.506121 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.506126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.506468 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.506798 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.506803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.506885 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.507357 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.507359 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.507453 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.508132 (+ 679us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.508299 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1092,"mutex_wait_us":538,"spinlock_wait_cycles":7040,"thread_start_us":94,"threads_started":1}
I20260808 18:39:04.508899 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.4.61.253:41157)
0808 18:39:04.463039 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.463045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.463668 (+ 623us) server_negotiation.cc:407] Connection header received
0808 18:39:04.463777 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.463780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.463843 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.463916 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.464729 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465553 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.466830 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467175 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467248 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.502246 (+ 34998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.502253 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.502256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.502298 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.505910 (+ 3612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506772 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.506777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.506780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.506910 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.507310 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.507314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.507316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.507598 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.507697 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.508533 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.508704 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:39:04.510720 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.462772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58092)
0808 18:39:04.463424 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.463438 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.463695 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.464062 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.464065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.464457 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.464598 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.464605 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.465711 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.465714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.466687 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.466698 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.467421 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.467424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.467751 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.500787 (+ 33036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.500808 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.501417 (+ 609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.506074 (+ 4657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.506079 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.506081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.506541 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.507056 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.507060 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.507062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.507175 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.507862 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.507866 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.508281 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.510233 (+ 1952us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.510503 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":76,"thread_start_us":468,"threads_started":1}
I20260808 18:39:04.523074 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:38951
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:45591
--webserver_port=40405
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214343, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.254@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
I20260808 18:39:04.527367 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.513187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56152)
0808 18:39:04.513321 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.513337 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.513429 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.518836 (+ 5407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.518840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.519062 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.519177 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.519186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.520250 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.520254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.521065 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.521079 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.521662 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.521667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.521776 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.522389 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.522404 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.523801 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.525635 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.525638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.525640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.525913 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.526210 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.526214 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.526216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.526337 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.526792 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.526796 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.526916 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.527026 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.527183 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 18:39:04.527400 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.514703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56152 (local address 127.4.61.252:45237)
0808 18:39:04.518531 (+ 3828us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.518535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.518550 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:39:04.518632 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.518635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.518684 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.518769 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.519323 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.520111 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.521193 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.521532 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.521633 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.523963 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.523967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.523970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.523997 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.525512 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.526018 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.526021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.526023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.526115 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.526430 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.526434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.526436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.526678 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.526776 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.527110 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.527234 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3740}
I20260808 18:39:04.528792 13623 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.61.252:45237: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4f1169a67c834e209fb0193eff82483d"
member_type: NON_VOTER
last_known_addr {
host: "127.4.61.252"
port: 45237
}
attrs {
promote: true
}
}
dest_uuid: "4c4cdfba4abe4a8492f81506c656c19a"
cas_config_opid_index: 5
I20260808 18:39:04.529543 13623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } }
I20260808 18:39:04.530730 14418 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4f1169a67c834e209fb0193eff82483d (127.4.61.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.532439 14418 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.61.252:45237
I20260808 18:39:04.532651 14416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.532757 14416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:04.533628 14617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:04.534474 14429 master.cc:537] Master@127.4.61.252:45237 shutting down...
I20260808 18:39:04.535372 14617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 18:39:04.536123 14416 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 18:39:04.538174 13595 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a -> Peer 4f1169a67c834e209fb0193eff82483d (127.4.61.252:45237): Couldn't send request to peer 4f1169a67c834e209fb0193eff82483d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 18:39:04.539666 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.530917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58096)
0808 18:39:04.531162 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.531178 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.531262 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.531622 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.531625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.531645 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:04.531731 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.531737 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.532755 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.532759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.534025 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.534037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.539195 (+ 5158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.539199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.539307 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.539366 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.539445 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.539533 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260808 18:39:04.540148 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.531186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58096 (local address 127.4.61.253:41157)
0808 18:39:04.531306 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.531311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.531340 (+ 29us) server_negotiation.cc:407] Connection header received
0808 18:39:04.531396 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.531399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.531470 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.531584 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:04.531853 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.532624 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.538362 (+ 5738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.539058 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.539173 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.539346 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.539928 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.540020 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:39:04.541347 14498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 LEARNER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 18:39:04.541764 14416 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 18:39:04.541852 14429 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:04.542160 14429 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:04.542255 14429 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: stopping tablet replica
I20260808 18:39:04.543746 14498 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4f1169a67c834e209fb0193eff82483d (127.4.61.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.545604 14696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c4cdfba4abe4a8492f81506c656c19a. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.545630 14549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: NON_VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: true } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.545722 14696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: LEARNER
I20260808 18:39:04.545742 14549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: LEARNER
I20260808 18:39:04.547619 14416 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: attempting to promote NON_VOTER 74e053c0634c47969d6e632cfa55b359 to VOTER
I20260808 18:39:04.548100 14416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } }
I20260808 18:39:04.549391 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.549067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56158)
0808 18:39:04.549229 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.549298 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:45237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 18:39:04.549785 14498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 LEARNER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 18:39:04.550081 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.549850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56166)
0808 18:39:04.549977 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.550019 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:45237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 18:39:04.550189 13595 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a -> Peer 4f1169a67c834e209fb0193eff82483d (127.4.61.252:45237): Couldn't send request to peer 4f1169a67c834e209fb0193eff82483d. Status: Network error: Client connection negotiation failed: client connection to 127.4.61.252:45237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 18:39:04.550230 14417 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 18:39:04.551147 14429 master.cc:552] Master@127.4.61.252:45237 shutdown complete.
I20260808 18:39:04.551198 14429 master_runner.cc:305] Clearing existing system tablet
I20260808 18:39:04.551440 14429 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.551499 14429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.552160 14417 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 74e053c0634c47969d6e632cfa55b359 (127.4.61.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.552971 14429 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.553539 14417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.553637 14417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:04.553769 14417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.553846 14417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:04.554585 14699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.554782 14429 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.554731 14498 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 74e053c0634c47969d6e632cfa55b359 (127.4.61.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.554886 14429 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.554917 14429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "4f1169a67c834e209fb0193eff82483d"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "e5ad6de451fa21b7b6e8d2ab6f02827a"
server_key_iv: "3f6d06c9239adc6f8722a95b71b0ab5b"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.556644 14549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.556756 14549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:04.556967 14429 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:04.559404 14429 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 18:39:04.559505 14429 log.cc:1196] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 18:39:04.559746 14429 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Deleting consensus metadata
I20260808 18:39:04.559913 14429 master_runner.cc:315] Copying system tablet from 127.4.61.254:45591
I20260808 18:39:04.561184 14429 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: tablet copy: Beginning tablet copy session from remote peer at address 127.4.61.254:45591
I20260808 18:39:04.570657 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.561908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50236 (local address 127.4.61.254:45591)
0808 18:39:04.562031 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.562035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.562604 (+ 569us) server_negotiation.cc:407] Connection header received
0808 18:39:04.562722 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.562725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.562787 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.562867 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.563366 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.564167 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.565276 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.565595 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.565698 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.567000 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.567005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.567007 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.567037 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.568747 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.569243 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.569246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.569248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.569330 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.569621 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.569625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.569627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.569869 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.569944 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.570351 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.570489 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:39:04.571532 14707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.561825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50236)
0808 18:39:04.562501 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.562516 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.562637 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.562897 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.562900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.563118 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.563234 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.563242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.564288 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.564291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.565144 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.565156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.565714 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.565718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.565804 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.566398 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.566412 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.566841 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.568887 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.568891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.568893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.569143 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.569432 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.569435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.569437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.569521 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.570017 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.570020 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.570123 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.571195 (+ 1072us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.571366 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":72,"threads_started":1}
I20260808 18:39:04.572275 13649 tablet_copy_service.cc:140] P 4c4cdfba4abe4a8492f81506c656c19a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4f1169a67c834e209fb0193eff82483d ({username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:50236)
I20260808 18:39:04.572386 13649 tablet_copy_service.cc:161] P 4c4cdfba4abe4a8492f81506c656c19a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4f1169a67c834e209fb0193eff82483d at {username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:50236: session id = 4f1169a67c834e209fb0193eff82483d-00000000000000000000000000000000
I20260808 18:39:04.573518 13649 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 18:39:04.575047 14429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 18:39:04.577661 14429 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: tablet copy: Starting download of 0 data blocks...
I20260808 18:39:04.577857 14429 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: tablet copy: Starting download of 1 WAL segments...
I20260808 18:39:04.579587 14429 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 18:39:04.581539 13649 tablet_copy_service.cc:342] P 4c4cdfba4abe4a8492f81506c656c19a: Request end of tablet copy session 4f1169a67c834e209fb0193eff82483d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:50236
I20260808 18:39:04.581621 13649 tablet_copy_service.cc:433] P 4c4cdfba4abe4a8492f81506c656c19a: ending tablet copy session 4f1169a67c834e209fb0193eff82483d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4f1169a67c834e209fb0193eff82483d
I20260808 18:39:04.590251 14429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:04.592185 14709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.592422 14712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.592665 14429 server_base.cc:1034] running on GCE node
W20260808 18:39:04.592801 14710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.593079 14429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.593410 14429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.594548 14429 hybrid_clock.cc:648] HybridClock initialized: now 1786214344594534 us; error 32 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.596230 14429 init.cc:377] Logged in from keytab as oryx/127.4.61.252@KRBTEST.COM (short username oryx)
I20260808 18:39:04.596711 14429 webserver.cc:460] Webserver started at http://127.4.61.252:37031/ using document root <none> and password file <none>
I20260808 18:39:04.596895 14429 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.596936 14429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.598356 14429 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:04.602501 14722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.602753 14429 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260808 18:39:04.602850 14429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "4f1169a67c834e209fb0193eff82483d"
format_stamp: "Formatted at 2026-08-08 18:39:04 on dist-test-slave-fgb3"
server_key: "e5ad6de451fa21b7b6e8d2ab6f02827a"
server_key_iv: "3f6d06c9239adc6f8722a95b71b0ab5b"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.602946 14429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.614826 14429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.616819 14429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.621780 14429 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.252:45237
I20260808 18:39:04.622439 14429 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
I20260808 18:39:04.622658 14788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.252:45237 every 8 connection(s)
I20260808 18:39:04.627857 14789 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:39:04.628965 14789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Bootstrap starting.
I20260808 18:39:04.638634 14789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:39:04.638906 14789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Bootstrap complete.
I20260808 18:39:04.639410 14789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } }
I20260808 18:39:04.639529 14789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4f1169a67c834e209fb0193eff82483d, State: Initialized, Role: LEARNER
I20260808 18:39:04.639616 14789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } }
I20260808 18:39:04.639957 14793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.640075 14793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: LEARNER
I20260808 18:39:04.640093 14789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:04.642918 14808 catalog_manager.cc:1259] Loaded cluster ID: 6d27ab38df7847c6b8f875c08988de51
I20260808 18:39:04.642980 14808 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: loading cluster ID for follower catalog manager: success
I20260808 18:39:04.645176 14808 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: acquiring CA information for follower catalog manager: success
I20260808 18:39:04.646595 14808 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 18:39:04.662377 14693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:04.662643 14693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:04.662688 14693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:04.666653 14693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:04.666711 14693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:04.666770 14693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:04.672137 14693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:38951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=40405
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:04.673228 14693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:04.674224 14693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:39:04.676293 14087 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
W20260808 18:39:04.684439 14817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.684402 14814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.684427 14813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.684616 14693 server_base.cc:1034] running on GCE node
I20260808 18:39:04.685086 14693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.685727 14693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.686894 14693 hybrid_clock.cc:648] HybridClock initialized: now 1786214344686861 us; error 44 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.689648 14693 init.cc:377] Logged in from keytab as oryx/127.4.61.193@KRBTEST.COM (short username oryx)
I20260808 18:39:04.690596 14693 webserver.cc:460] Webserver started at http://127.4.61.193:40405/ using document root <none> and password file <none>
I20260808 18:39:04.691156 14693 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.691246 14693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.695134 14693 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 18:39:04.697196 14827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.698455 14693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:04.698566 14693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "2608011434474099afa9bb739d425c33"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "cb2074cbc1fd56a61084492477af42c8"
server_key_iv: "5d6173d9282b609a95290b4e52f5df63"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.699131 14693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.710146 14693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.712850 14693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:04.713021 14693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.713587 14693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:04.714481 14693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:04.714542 14693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.714603 14693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:04.714629 14693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.724078 14693 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:38951
I20260808 18:39:04.724107 14985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:38951 every 8 connection(s)
I20260808 18:39:04.725068 14693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:04.731335 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 14693
I20260808 18:39:04.731527 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 13905
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
I20260808 18:39:04.742704 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:50771 (local address 127.4.61.253:41157)
0808 18:39:04.727676 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.727680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.728378 (+ 698us) server_negotiation.cc:407] Connection header received
0808 18:39:04.729654 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.729658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.729720 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.729800 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.731372 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.732217 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.733849 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.734154 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.734255 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.737570 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.737574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.737576 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.737603 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.739802 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.740440 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.740444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.740446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.740530 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.740927 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.740931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.740932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.741179 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.741277 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.742415 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.742536 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:39:04.743732 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.4.61.193:50771)
0808 18:39:04.728209 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.728278 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.729437 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.729998 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.730006 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.730581 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.731196 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.731217 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.732394 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.732397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.733679 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.733690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.734500 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.734505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.734711 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.735678 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.735699 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.737385 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.739940 (+ 2555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.739947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.739964 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.740324 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.740636 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.740638 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.740640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.740836 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.741293 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.741300 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.742153 (+ 853us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.742368 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.742696 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":47,"thread_start_us":212,"threads_started":1}
I20260808 18:39:04.744987 14988 heartbeater.cc:347] Connected to a master server at 127.4.61.253:41157
I20260808 18:39:04.745271 14988 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.745872 14988 heartbeater.cc:511] Master 127.4.61.253:41157 requested a full tablet report, sending...
I20260808 18:39:04.746908 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:48765 (local address 127.4.61.252:45237)
0808 18:39:04.727364 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.727369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.728790 (+ 1421us) server_negotiation.cc:407] Connection header received
0808 18:39:04.729967 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.729971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.730030 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.730286 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.731427 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.732453 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.740406 (+ 7953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.740682 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.740788 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.743146 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.743150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.743153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.743183 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.745006 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.745467 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.745471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.745473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.745636 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.745945 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.745949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.745951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.746185 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.746283 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.746605 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.746742 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
I20260808 18:39:04.747102 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:46745
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:45591
--webserver_port=34787
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:39:04.747486 14480 ts_manager.cc:194] Registered new tserver with Master: 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:04.747906 14992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.4.61.193:48765)
0808 18:39:04.728688 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.728700 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.729431 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.730308 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.730339 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.730581 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.731196 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.731242 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.739320 (+ 8078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.739323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.740256 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.740269 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.740793 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.740797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.740965 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.741611 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.741623 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.742996 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.745128 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.745131 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.745133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.745364 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.745727 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.745730 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.745732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.745834 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.746287 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.746290 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.746406 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.747519 (+ 1113us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.747706 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"mutex_wait_us":222,"spinlock_wait_cycles":15488,"thread_start_us":107,"threads_started":1}
I20260808 18:39:04.749037 14986 heartbeater.cc:347] Connected to a master server at 127.4.61.252:45237
I20260808 18:39:04.749128 14986 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.749313 14986 heartbeater.cc:511] Master 127.4.61.252:45237 requested a full tablet report, sending...
I20260808 18:39:04.750499 14744 ts_manager.cc:194] Registered new tserver with Master: 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:04.754593 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51679 (local address 127.4.61.254:45591)
0808 18:39:04.727953 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.727957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.728587 (+ 630us) server_negotiation.cc:407] Connection header received
0808 18:39:04.729766 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.729769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.729817 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.729882 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.746872 (+ 16990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.747630 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.748736 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.749066 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.749148 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.751379 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.751383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.751385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.751412 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.752823 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.753262 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.753284 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.753285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.753356 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.753697 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.753701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.753702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.753908 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.753986 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.754364 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.754479 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 18:39:04.754606 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.727595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:51679)
0808 18:39:04.728510 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.728521 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.729431 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.729997 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.730006 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.730580 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.746714 (+ 16134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.746725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.747778 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.747781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.748583 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.748595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.749333 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.749337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.749422 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.749801 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.749814 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.751203 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.752933 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.752937 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.752938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.753173 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.753484 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.753487 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.753489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.753594 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.754018 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.754021 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.754123 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.754236 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.754400 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":174,"spinlock_wait_cycles":31488,"thread_start_us":128,"threads_started":1}
I20260808 18:39:04.755409 14987 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:04.755497 14987 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.755685 14987 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
I20260808 18:39:04.756484 13623 ts_manager.cc:194] Re-registered known tserver with Master: 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:04.757046 13623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:51679
W20260808 18:39:04.861768 14996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:04.862030 14996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:04.862092 14996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:04.866102 14996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:04.866163 14996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:04.866241 14996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:04.871815 14996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:46745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=34787
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:04.872887 14996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:04.873922 14996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:04.883689 15009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.883729 15005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:04.883708 15006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:04.883854 14996 server_base.cc:1034] running on GCE node
I20260808 18:39:04.884377 14996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:04.884961 14996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:04.886121 14996 hybrid_clock.cc:648] HybridClock initialized: now 1786214344886103 us; error 44 us; skew 500 ppm
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:04.889037 14996 init.cc:377] Logged in from keytab as oryx/127.4.61.194@KRBTEST.COM (short username oryx)
I20260808 18:39:04.889670 14266 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
I20260808 18:39:04.890292 14996 webserver.cc:460] Webserver started at http://127.4.61.194:34787/ using document root <none> and password file <none>
I20260808 18:39:04.890957 14996 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:04.891079 14996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:04.895120 14996 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 18:39:04.897234 15019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.898535 14996 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:04.898643 14996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "8a1c03ab56ee9b1fec319177599677ec"
server_key_iv: "7b4b348f6e1829c81c10af07863e251d"
server_key_version: "encryptionkey@0"
I20260808 18:39:04.899194 14996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:04.921766 14996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:04.924861 14996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:04.925019 14996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:04.925601 14996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:04.926538 14996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:04.926589 14996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.926631 14996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:04.926651 14996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:04.936825 14996 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:46745
I20260808 18:39:04.936857 15182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:46745 every 8 connection(s)
I20260808 18:39:04.937819 14996 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:04.945539 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 14996
I20260808 18:39:04.945729 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 14095
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
I20260808 18:39:04.954165 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:58143 (local address 127.4.61.254:45591)
0808 18:39:04.940743 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.940747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.941519 (+ 772us) server_negotiation.cc:407] Connection header received
0808 18:39:04.942552 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.942555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.942615 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.942689 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.944340 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.945140 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.946917 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.947180 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.947242 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.950007 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.950011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.950014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.950047 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.951695 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.952477 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.952481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.952483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.952578 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.953033 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.953037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.953039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.953303 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.953387 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.953907 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.954020 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260808 18:39:04.954284 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:46775 (local address 127.4.61.253:41157)
0808 18:39:04.940727 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.940732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.941583 (+ 851us) server_negotiation.cc:407] Connection header received
0808 18:39:04.942572 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.942576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.942632 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.942682 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.944418 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.945442 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.947221 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.947659 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.947748 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.950251 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.950256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.950260 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.950293 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.952232 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.952652 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.952656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.952657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.952744 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.953043 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.953046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.953047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.953227 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.953281 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.953957 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.954105 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:04.955657 15190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:58143)
0808 18:39:04.941235 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.941276 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.942344 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.942881 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.942888 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.943368 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.944166 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.944187 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.945362 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.945365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.946793 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.946805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.947417 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.947421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.947604 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.948184 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.948203 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.949810 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.951867 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.951875 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.951895 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.952335 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.952689 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.952692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.952694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.952901 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.953474 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.953477 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.953650 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.954370 (+ 720us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.954676 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":778,"mutex_wait_us":86,"spinlock_wait_cycles":110336,"thread_start_us":145,"threads_started":1}
I20260808 18:39:04.955664 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.4.61.194:46775)
0808 18:39:04.941287 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.941302 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.942350 (+ 1048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.942883 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.942891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.943373 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.944190 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.944199 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.945704 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.945707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.947067 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.947080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.947929 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.947934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.948039 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.948609 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.948626 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.950100 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.952347 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.952350 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.952352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.952548 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.952851 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.952854 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.952855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.952963 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.953355 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.953361 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.953636 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.955047 (+ 1411us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.955223 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":958,"mutex_wait_us":624,"spinlock_wait_cycles":68736,"thread_start_us":124,"threads_started":1}
I20260808 18:39:04.957660 15187 heartbeater.cc:347] Connected to a master server at 127.4.61.253:41157
I20260808 18:39:04.957928 15187 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.958115 15185 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:04.958216 15185 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.958585 15187 heartbeater.cc:511] Master 127.4.61.253:41157 requested a full tablet report, sending...
I20260808 18:39:04.958585 15185 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
I20260808 18:39:04.959976 14480 ts_manager.cc:194] Registered new tserver with Master: 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745)
I20260808 18:39:04.960006 13623 ts_manager.cc:194] Re-registered known tserver with Master: 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745)
Aug 08 18:39:04 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214344, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
I20260808 18:39:04.960945 13623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:58143
I20260808 18:39:04.965127 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:56305 (local address 127.4.61.252:45237)
0808 18:39:04.940587 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.940592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.941637 (+ 1045us) server_negotiation.cc:407] Connection header received
0808 18:39:04.942572 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.942576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.942633 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.942682 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:04.944354 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.945186 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.958560 (+ 13374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.958914 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.959001 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.961451 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:04.961454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:04.961457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:04.961481 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:04.963468 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.964004 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.964008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.964010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.964094 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:04.964357 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:04.964361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:04.964362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:04.964536 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:04.964622 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.964867 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.964990 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:39:04.965133 15189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.940238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.4.61.194:56305)
0808 18:39:04.941400 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.941414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.942345 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.942883 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.942891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.943377 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:04.944188 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.944199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.957526 (+ 13327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.957529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.958395 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.958407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.959182 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.959186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.959276 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.959766 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:04.959779 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:04.961310 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:04.963633 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.963637 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.963639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.963894 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.964193 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:04.964195 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:04.964197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:04.964264 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:04.964630 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:04.964633 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:04.964711 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.964804 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.964958 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1078,"mutex_wait_us":794,"spinlock_wait_cycles":16896,"thread_start_us":82,"threads_started":1}
I20260808 18:39:04.967200 15183 heartbeater.cc:347] Connected to a master server at 127.4.61.252:45237
I20260808 18:39:04.967315 15183 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:04.967556 15183 heartbeater.cc:511] Master 127.4.61.252:45237 requested a full tablet report, sending...
I20260808 18:39:04.968248 14744 ts_manager.cc:194] Registered new tserver with Master: 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745)
I20260808 18:39:04.969903 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:36749
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:45591
--webserver_port=46623
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:39:04.990701 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.986899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56170)
0808 18:39:04.987032 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:04.987050 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:04.987160 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:04.987446 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:04.987448 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:04.987474 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:04.987576 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.987582 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.988601 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.988604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.989396 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:04.989407 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.990289 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.990293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:04.990415 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.990439 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:39:04.990512 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 18:39:04.990582 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 18:39:04.990728 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:04.987005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56170 (local address 127.4.61.252:45237)
0808 18:39:04.987163 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:04.987168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:04.987186 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:39:04.987242 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:04.987245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:04.987306 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:04.987419 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:04.987682 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.988480 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.989532 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:04.990147 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:04.990255 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:04.990447 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:04.990537 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 18:39:04.990605 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 18:39:04.991432 14753 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 18:39:04.991838 14793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c4cdfba4abe4a8492f81506c656c19a. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:04.991987 14793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: LEARNER
W20260808 18:39:05.085206 15193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:05.085479 15193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:05.085539 15193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:05.089540 15193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:05.089601 15193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:05.089685 15193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:05.095125 15193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:36749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=46623
--tserver_master_addrs=127.4.61.254:45591,127.4.61.253:41157,127.4.61.252:45237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:05.096225 15193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:05.097265 15193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:05.106874 15203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:05.106858 15205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:05.107007 15193 server_base.cc:1034] running on GCE node
W20260808 18:39:05.106856 15207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:05.107515 15193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:05.108108 15193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:05.109292 15193 hybrid_clock.cc:648] HybridClock initialized: now 1786214345109260 us; error 39 us; skew 500 ppm
Aug 08 18:39:05 dist-test-slave-fgb3 krb5kdc[13547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214345, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:05.112346 15193 init.cc:377] Logged in from keytab as oryx/127.4.61.195@KRBTEST.COM (short username oryx)
I20260808 18:39:05.113195 15193 webserver.cc:460] Webserver started at http://127.4.61.195:46623/ using document root <none> and password file <none>
I20260808 18:39:05.113746 15193 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:05.113844 15193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:05.117854 15193 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:39:05.119984 15217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:05.121266 15193 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:05.121382 15193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "512cf31132ca4e2299f3c2864bb53dd6"
format_stamp: "Formatted at 2026-08-08 18:39:03 on dist-test-slave-fgb3"
server_key: "d1bb73b76b1fae9e4c30b5e5ab5f7be3"
server_key_iv: "e69c4936c1869b58aaa29ab7bb5a787d"
server_key_version: "encryptionkey@0"
I20260808 18:39:05.121919 15193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:05.140424 15193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:05.143584 15193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:05.143771 15193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:05.144378 15193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:05.145260 15193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:05.145309 15193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:05.145362 15193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:05.145390 15193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:05.154356 15193 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:36749
I20260808 18:39:05.154433 15380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:36749 every 8 connection(s)
I20260808 18:39:05.155412 15193 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:05.156512 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 15193
Aug 08 18:39:05 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214345, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.252@KRBTEST.COM
I20260808 18:39:05.171825 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.158439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50252 (local address 127.4.61.254:45591)
0808 18:39:05.158648 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.158652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.161094 (+ 2442us) server_negotiation.cc:407] Connection header received
0808 18:39:05.161258 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.161262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.161314 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.161397 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.162277 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.163055 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.164910 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.165237 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.165305 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.167048 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.167053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.167056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.167084 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.168982 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.170217 (+ 1235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.170222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.170223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.170347 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.170711 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.170716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.170717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.170948 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.171064 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.171507 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.171631 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
Aug 08 18:39:05 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214345, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.253@KRBTEST.COM
I20260808 18:39:05.173076 15404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.159650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.4.61.253:41157)
0808 18:39:05.159897 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.159901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.160384 (+ 483us) server_negotiation.cc:407] Connection header received
0808 18:39:05.160441 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.160445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.160503 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.160758 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.161689 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.162531 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.163687 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.164030 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.164125 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.167242 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.167246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.167249 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.167275 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.170026 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.171153 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.171157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.171159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.171249 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.171590 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.171593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.171595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.171808 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.171937 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.172785 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.172913 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":93,"threads_started":1}
Aug 08 18:39:05 dist-test-slave-fgb3 krb5kdc[13547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214345, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:05.174595 15398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.159343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.4.61.252:45237)
0808 18:39:05.159568 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.159572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.162419 (+ 2847us) server_negotiation.cc:407] Connection header received
0808 18:39:05.162630 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.162633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.162687 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.162933 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.163971 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.165047 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.166487 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.166820 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.166906 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.168938 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.168942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.168944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.168972 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.171302 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.171735 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.171738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.171740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.171835 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.173000 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.173004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.173006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.173219 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.173315 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.174253 (+ 938us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.174414 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":81,"threads_started":1}
I20260808 18:39:05.177894 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.157498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:51423 (local address 127.4.61.252:45237)
0808 18:39:05.157632 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.157637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.161751 (+ 4114us) server_negotiation.cc:407] Connection header received
0808 18:39:05.161807 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.161810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.161865 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.161943 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.163812 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.164611 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.168916 (+ 4305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.169243 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.169326 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.173430 (+ 4104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.173434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.173437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.173464 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.175161 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.175930 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.175933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.175935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.176029 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.176606 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.176609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.176611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.176840 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.176921 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.177631 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.177736 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":44}
I20260808 18:39:05.176594 13623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50252:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 18:39:05.179808 15395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.158686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:54707)
0808 18:39:05.159977 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.160006 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.161076 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.166505 (+ 5429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.166508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.166723 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:05.166847 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.166855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.167884 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.167888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.168751 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.168764 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.169906 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.169911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.170026 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.172356 (+ 2330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:05.172373 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:05.175773 (+ 3400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:05.177854 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.177857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.177858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.178169 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.178509 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.178512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.178514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.178598 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.179067 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:05.179070 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:05.179159 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.179252 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.179392 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1228,"spinlock_wait_cycles":3712,"thread_start_us":122,"threads_started":1}
I20260808 18:39:05.180091 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.157302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:55691 (local address 127.4.61.253:41157)
0808 18:39:05.157441 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.157446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.160219 (+ 2773us) server_negotiation.cc:407] Connection header received
0808 18:39:05.164238 (+ 4019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.164240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.164283 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.164332 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.164864 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.165561 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.168191 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.168572 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.168648 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.176017 (+ 7369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.176021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.176024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.176045 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.177723 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.178422 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.178426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.178428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.178573 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.179024 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.179028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.179029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.179248 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.179358 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.179788 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.179934 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 18:39:05.180266 15396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.158758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:54707 (local address 127.4.61.254:45591)
0808 18:39:05.160644 (+ 1886us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.160649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.160667 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:39:05.161423 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.161427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.161484 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.166381 (+ 4897us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.166984 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.167740 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.169413 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.169782 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.169888 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.175919 (+ 6031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.175923 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.175925 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.175950 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.177740 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.178283 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.178286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.178288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.178409 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.178702 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.178705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.178706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.178941 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.179023 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.179989 (+ 966us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.180105 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1804,"thread_start_us":79,"threads_started":1}
I20260808 18:39:05.180718 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.159316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.4.61.195:51423)
0808 18:39:05.161407 (+ 2091us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.161421 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.161698 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.162265 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.162276 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.162871 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:05.163581 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.163604 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.164818 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.164822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.166204 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.166217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.169501 (+ 3284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.169506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.169608 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.170301 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:05.170349 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:05.173229 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:05.175291 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.175297 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.175313 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.175782 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.176298 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.176300 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.176301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.176483 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.176991 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:05.176999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:05.177339 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.178287 (+ 948us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.178722 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2022,"thread_start_us":106,"threads_started":1}
W20260808 18:39:05.180924 13623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:05.181483 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.157813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.4.61.195:55691)
0808 18:39:05.159852 (+ 2039us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.159908 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.161057 (+ 1149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.164467 (+ 3410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.164469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.164641 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:05.164747 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.164754 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.165686 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.165690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.167724 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.167737 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.168842 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.168847 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.169060 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.170580 (+ 1520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:05.170595 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:05.175889 (+ 5294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:05.177860 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.177864 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.177866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.178257 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.178709 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:05.178713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:05.178715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:05.178901 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:05.179460 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:05.179463 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:05.179563 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.180318 (+ 755us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.180470 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1808,"spinlock_wait_cycles":5504,"thread_start_us":666,"threads_started":1}
I20260808 18:39:05.181737 15381 heartbeater.cc:347] Connected to a master server at 127.4.61.252:45237
I20260808 18:39:05.181737 15382 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45591
I20260808 18:39:05.181993 15381 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:05.181993 15382 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:05.182340 15384 heartbeater.cc:347] Connected to a master server at 127.4.61.253:41157
I20260808 18:39:05.182432 15384 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:05.182622 15382 heartbeater.cc:511] Master 127.4.61.254:45591 requested a full tablet report, sending...
I20260808 18:39:05.182622 15381 heartbeater.cc:511] Master 127.4.61.252:45237 requested a full tablet report, sending...
I20260808 18:39:05.182621 15384 heartbeater.cc:511] Master 127.4.61.253:41157 requested a full tablet report, sending...
I20260808 18:39:05.183821 13620 ts_manager.cc:194] Re-registered known tserver with Master: 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749)
I20260808 18:39:05.184090 15407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: NON_VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: true } } }
I20260808 18:39:05.184231 15407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:05.184540 13620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:54707
I20260808 18:39:05.186805 14480 ts_manager.cc:194] Registered new tserver with Master: 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749)
I20260808 18:39:05.187177 14744 ts_manager.cc:194] Registered new tserver with Master: 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749)
I20260808 18:39:05.187985 15406 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: attempting to promote NON_VOTER 4f1169a67c834e209fb0193eff82483d to VOTER
I20260808 18:39:05.188362 15406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } }
I20260808 18:39:05.190610 14753 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 LEARNER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 18:39:05.191095 14498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Refusing update from remote peer 4c4cdfba4abe4a8492f81506c656c19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 18:39:05.191274 15406 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 18:39:05.191506 15407 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 18:39:05.192926 15407 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4f1169a67c834e209fb0193eff82483d (127.4.61.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.193588 14498 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4f1169a67c834e209fb0193eff82483d (127.4.61.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.194352 15407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.194056 14753 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4f1169a67c834e209fb0193eff82483d (127.4.61.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.194455 15407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:05.194578 15407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.194649 15407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:05.194722 15407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.194810 15407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:05.196167 14793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.196291 14793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:05.196246 15421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c4cdfba4abe4a8492f81506c656c19a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:05.196365 15421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:05.205960 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.198865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:46745 (local address 127.0.0.1:58216)
0808 18:39:05.198985 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.199001 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.199081 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.200349 (+ 1268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.200351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.200363 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:05.200449 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.200453 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.202298 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.202301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.203356 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.203367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.205657 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.205660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.205726 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.205748 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.205795 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.205854 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 18:39:05.206164 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.199071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58216 (local address 127.4.61.194:46745)
0808 18:39:05.199575 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.199590 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.199619 (+ 29us) server_negotiation.cc:407] Connection header received
0808 18:39:05.199712 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.199719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.200010 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.200408 (+ 398us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:05.200568 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.202183 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.204671 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.205541 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.205661 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.205835 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.205896 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.206000 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":139,"threads_started":1}
I20260808 18:39:05.207283 15427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.199538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36749 (local address 127.0.0.1:49960)
0808 18:39:05.200151 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.200168 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.200423 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.201343 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.201345 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.201362 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:05.201435 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.201439 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.203613 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.203615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.204599 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.204609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.206906 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.206909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.206998 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.207024 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.207073 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.207144 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":111,"threads_started":1}
I20260808 18:39:05.207530 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.199673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.4.61.195:36749)
0808 18:39:05.200689 (+ 1016us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.200715 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.200740 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:39:05.200825 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.200831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.201033 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.201385 (+ 352us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:05.201528 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.203507 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.205897 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.206770 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.206891 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.207041 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.207125 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.207231 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":91,"threads_started":1}
I20260808 18:39:05.207971 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.199241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38951 (local address 127.0.0.1:43308)
0808 18:39:05.199783 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.199797 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.200075 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.203101 (+ 3026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.203105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.203127 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:05.203237 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.203246 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.204625 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.204628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.205744 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.205756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.207417 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.207423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.207510 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.207536 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.207618 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.207847 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":101,"threads_started":1}
I20260808 18:39:05.208274 15431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.199405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.4.61.193:38951)
0808 18:39:05.202549 (+ 3144us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.202565 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.202586 (+ 21us) server_negotiation.cc:407] Connection header received
0808 18:39:05.202653 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.202657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.202811 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.203120 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:05.203376 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.204525 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.206407 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.207007 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.207110 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.207246 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.207784 (+ 538us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.207899 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3029,"thread_start_us":69,"threads_started":1}
I20260808 18:39:05.209623 15088 tablet_service.cc:1467] Processing CreateTablet for tablet 37dc10ae44304711970371073e8c1e2b (DEFAULT_TABLE table=test-table [id=d1a648e22dcc40498135c09d02e1b39e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:05.210906 15088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37dc10ae44304711970371073e8c1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:05.210835 15287 tablet_service.cc:1467] Processing CreateTablet for tablet 37dc10ae44304711970371073e8c1e2b (DEFAULT_TABLE table=test-table [id=d1a648e22dcc40498135c09d02e1b39e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:05.211040 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 37dc10ae44304711970371073e8c1e2b (DEFAULT_TABLE table=test-table [id=d1a648e22dcc40498135c09d02e1b39e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:05.211908 15287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37dc10ae44304711970371073e8c1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:05.212014 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37dc10ae44304711970371073e8c1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:05.218279 15435 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Bootstrap starting.
I20260808 18:39:05.219609 15437 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Bootstrap starting.
I20260808 18:39:05.221050 15435 tablet_bootstrap.cc:654] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:05.221715 15437 tablet_bootstrap.cc:654] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:05.221936 15435 log.cc:824] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:05.222517 15437 log.cc:824] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:05.222688 15438 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Bootstrap starting.
I20260808 18:39:05.224021 15435 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: No bootstrap required, opened a new log
I20260808 18:39:05.224184 15435 ts_tablet_manager.cc:1397] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:39:05.224653 15437 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: No bootstrap required, opened a new log
I20260808 18:39:05.224848 15438 tablet_bootstrap.cc:654] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:05.224988 15437 ts_tablet_manager.cc:1397] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:39:05.225696 15438 log.cc:824] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:05.227471 15435 raft_consensus.cc:348] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.227687 15435 raft_consensus.cc:374] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:05.227720 15435 raft_consensus.cc:729] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2608011434474099afa9bb739d425c33, State: Initialized, Role: FOLLOWER
I20260808 18:39:05.227854 15438 tablet_bootstrap.cc:492] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: No bootstrap required, opened a new log
I20260808 18:39:05.228041 15438 ts_tablet_manager.cc:1397] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:39:05.228199 15435 consensus_queue.cc:260] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.229413 15435 ts_tablet_manager.cc:1428] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:39:05.229683 14987 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
I20260808 18:39:05.230254 15437 raft_consensus.cc:348] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.230542 15437 raft_consensus.cc:374] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:05.230597 15437 raft_consensus.cc:729] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512cf31132ca4e2299f3c2864bb53dd6, State: Initialized, Role: FOLLOWER
I20260808 18:39:05.231052 15437 consensus_queue.cc:260] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.232060 15437 ts_tablet_manager.cc:1428] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260808 18:39:05.232491 15382 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
I20260808 18:39:05.237685 15438 raft_consensus.cc:348] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.237929 15438 raft_consensus.cc:374] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:05.237983 15438 raft_consensus.cc:729] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddb6a48d0c54bf7bce0d8d7728c6691, State: Initialized, Role: FOLLOWER
I20260808 18:39:05.238404 15438 consensus_queue.cc:260] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.239740 15438 ts_tablet_manager.cc:1428] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260808 18:39:05.241005 15185 heartbeater.cc:503] Master 127.4.61.254:45591 was elected leader, sending a full tablet report...
I20260808 18:39:05.275565 15445 raft_consensus.cc:482] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:05.275833 15445 raft_consensus.cc:504] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.277127 15445 leader_election.cc:288] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745), 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:05.281503 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.277449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:41197 (local address 127.4.61.194:46745)
0808 18:39:05.277579 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.277584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.277623 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:39:05.277680 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.277683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.277735 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.277808 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:05.278111 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.278766 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280187 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.280816 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280918 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.280961 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.281289 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.281373 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 18:39:05.281536 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.277338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:46745 (local address 127.4.61.195:41197)
0808 18:39:05.277456 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.277472 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.277562 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.277836 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.277839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.277861 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:05.278009 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.278018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.278886 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.278890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.280025 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.280033 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.280923 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.281112 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.281168 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.281244 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.281345 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":176}
I20260808 18:39:05.281543 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.277402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38951 (local address 127.4.61.195:44927)
0808 18:39:05.277508 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:05.277519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:05.277568 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:05.278060 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:05.278064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:05.278083 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:05.278185 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.278191 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.278932 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.278935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.280022 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:05.280033 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.280923 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:05.281114 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.281168 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 18:39:05.281248 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 18:39:05.281345 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":133}
I20260808 18:39:05.281667 15431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.277684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:44927 (local address 127.4.61.193:38951)
0808 18:39:05.277823 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.277828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.277841 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:05.277891 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.277894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.277941 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.278036 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:05.278302 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.278827 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280159 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.280782 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.280908 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.280961 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.281490 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.281564 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:05.282263 15117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37dc10ae44304711970371073e8c1e2b" candidate_uuid: "512cf31132ca4e2299f3c2864bb53dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" is_pre_election: true
I20260808 18:39:05.282464 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37dc10ae44304711970371073e8c1e2b" candidate_uuid: "512cf31132ca4e2299f3c2864bb53dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2608011434474099afa9bb739d425c33" is_pre_election: true
I20260808 18:39:05.282640 15117 raft_consensus.cc:2454] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 512cf31132ca4e2299f3c2864bb53dd6 in term 0.
I20260808 18:39:05.282720 14926 raft_consensus.cc:2454] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 512cf31132ca4e2299f3c2864bb53dd6 in term 0.
I20260808 18:39:05.283103 15220 leader_election.cc:302] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 512cf31132ca4e2299f3c2864bb53dd6, 6ddb6a48d0c54bf7bce0d8d7728c6691; no voters:
I20260808 18:39:05.283416 15445 raft_consensus.cc:2781] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:05.283497 15445 raft_consensus.cc:482] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:05.283550 15445 raft_consensus.cc:3037] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:05.284621 15445 raft_consensus.cc:504] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.284950 15445 leader_election.cc:288] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [CANDIDATE]: Term 1 election: Requested vote from peers 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745), 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:05.285307 15117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37dc10ae44304711970371073e8c1e2b" candidate_uuid: "512cf31132ca4e2299f3c2864bb53dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691"
I20260808 18:39:05.285328 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37dc10ae44304711970371073e8c1e2b" candidate_uuid: "512cf31132ca4e2299f3c2864bb53dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2608011434474099afa9bb739d425c33"
I20260808 18:39:05.285442 15117 raft_consensus.cc:3037] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:05.285442 14926 raft_consensus.cc:3037] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:05.286769 15117 raft_consensus.cc:2454] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 512cf31132ca4e2299f3c2864bb53dd6 in term 1.
I20260808 18:39:05.286768 14926 raft_consensus.cc:2454] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 512cf31132ca4e2299f3c2864bb53dd6 in term 1.
I20260808 18:39:05.287072 15224 leader_election.cc:302] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2608011434474099afa9bb739d425c33, 512cf31132ca4e2299f3c2864bb53dd6; no voters:
I20260808 18:39:05.287243 15445 raft_consensus.cc:2781] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:05.287483 15445 raft_consensus.cc:686] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 LEADER]: Becoming Leader. State: Replica: 512cf31132ca4e2299f3c2864bb53dd6, State: Running, Role: LEADER
I20260808 18:39:05.287840 15445 consensus_queue.cc:237] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } }
I20260808 18:39:05.291227 13623 catalog_manager.cc:5495] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "512cf31132ca4e2299f3c2864bb53dd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } health_report { overall_health: HEALTHY } } }
I20260808 18:39:05.304651 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.300448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49974 (local address 127.4.61.195:36749)
0808 18:39:05.300553 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.300557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.300571 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:05.300718 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.300722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.300780 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.300879 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:05.301075 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.301849 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.302871 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.303248 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.303342 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.303844 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:05.304267 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:05.304359 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.304475 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.304524 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 18:39:05.310017 14926 raft_consensus.cc:1261] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Refusing update from remote peer 512cf31132ca4e2299f3c2864bb53dd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:05.310263 15117 raft_consensus.cc:1261] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Refusing update from remote peer 512cf31132ca4e2299f3c2864bb53dd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:05.310833 15445 consensus_queue.cc:1035] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:05.311149 15447 consensus_queue.cc:1035] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:05.320716 15451 mvcc.cc:205] Tried to move back new op lower bound from 7316333958383484928 to 7316333958301806592. Current Snapshot: MvccSnapshot[applied={T|T < 7316333958383484928}]
I20260808 18:39:05.329099 13620 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:05.329289 13620 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:05.333268 15454 mvcc.cc:205] Tried to move back new op lower bound from 7316333958383484928 to 7316333958301806592. Current Snapshot: MvccSnapshot[applied={T|T < 7316333958383484928}]
I20260808 18:39:05.337406 13620 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c4cdfba4abe4a8492f81506c656c19a: Sending DeleteTablet for 3 replicas of tablet 37dc10ae44304711970371073e8c1e2b
I20260808 18:39:05.338119 15088 tablet_service.cc:1514] Processing DeleteTablet for tablet 37dc10ae44304711970371073e8c1e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:05 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:58216
I20260808 18:39:05.338413 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 37dc10ae44304711970371073e8c1e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:05 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43308
I20260808 18:39:05.338912 15287 tablet_service.cc:1514] Processing DeleteTablet for tablet 37dc10ae44304711970371073e8c1e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:05 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260808 18:39:05.338996 15464 tablet_replica.cc:330] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: stopping tablet replica
I20260808 18:39:05.339301 15464 raft_consensus.cc:2229] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:05.339625 15464 raft_consensus.cc:2258] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:05.340020 15461 tablet_replica.cc:330] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: stopping tablet replica
I20260808 18:39:05.342020 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 13567
I20260808 18:39:05.342021 15464 ts_tablet_manager.cc:1905] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:05.353314 15464 ts_tablet_manager.cc:1918] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:05.353444 15464 log.cc:1196] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/37dc10ae44304711970371073e8c1e2b
I20260808 18:39:05.353746 15464 ts_tablet_manager.cc:1939] T 37dc10ae44304711970371073e8c1e2b P 2608011434474099afa9bb739d425c33: Deleting consensus metadata
I20260808 18:39:05.340338 15461 raft_consensus.cc:2229] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:05.354740 15461 raft_consensus.cc:2258] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:05.356593 15461 ts_tablet_manager.cc:1905] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:05.356639 15465 tablet_replica.cc:330] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: stopping tablet replica
I20260808 18:39:05.357025 15465 raft_consensus.cc:2229] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:05.358633 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.340912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.4.61.253:41157)
0808 18:39:05.341032 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.341037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.341049 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:05.341087 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.341089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.341125 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.341193 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.342085 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.342769 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.351145 (+ 8376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.351514 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.351597 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.354548 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.354552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.354555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.354588 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.356456 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.357066 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.357070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.357072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.357160 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.357559 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.357562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.357564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.357804 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.357910 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.358344 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.358471 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 18:39:05.359241 15461 ts_tablet_manager.cc:1918] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:05.359336 15461 log.cc:1196] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/37dc10ae44304711970371073e8c1e2b
I20260808 18:39:05.359643 15461 ts_tablet_manager.cc:1939] T 37dc10ae44304711970371073e8c1e2b P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting consensus metadata
W20260808 18:39:05.362003 15021 connection.cc:535] server connection from 127.0.0.1:58216 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 18:39:05.362215 15465 raft_consensus.cc:2258] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 18:39:05.362406 14831 connection.cc:535] server connection from 127.0.0.1:43308 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 18:39:05.363790 15465 ts_tablet_manager.cc:1905] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:05.366441 15465 ts_tablet_manager.cc:1918] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:05.366547 15465 log.cc:1196] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/37dc10ae44304711970371073e8c1e2b
I20260808 18:39:05.366899 15465 ts_tablet_manager.cc:1939] T 37dc10ae44304711970371073e8c1e2b P 512cf31132ca4e2299f3c2864bb53dd6: Deleting consensus metadata
W20260808 18:39:05.367833 15221 connection.cc:441] server connection from 127.0.0.1:49960 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49960 (request call id 1) could send its response
I20260808 18:39:05.370528 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.340531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56192 (local address 127.4.61.252:45237)
0808 18:39:05.340639 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.340643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.360447 (+ 19804us) server_negotiation.cc:407] Connection header received
0808 18:39:05.360626 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.360630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.360685 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.360736 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.361697 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.362703 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.363894 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.364200 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.364321 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.366057 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.366061 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.366063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.366090 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.368020 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.368530 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.368534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.368536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.368622 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.368903 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.368906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.368908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.369102 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.369219 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.369793 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.370302 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:39:05.374503 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.365100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.4.61.253:41157)
0808 18:39:05.365238 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.365242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.366455 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 18:39:05.366491 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.366493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.366533 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.366602 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.367439 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.368191 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.369292 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.369593 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.369667 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.371261 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.371265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.371268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.371292 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.372676 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.373065 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.373068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.373070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.373155 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.373623 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.373626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.373627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.373831 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.373946 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.374184 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.374349 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 18:39:05.374717 15398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:05.364861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.4.61.252:45237)
0808 18:39:05.364975 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:05.364979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:05.365781 (+ 802us) server_negotiation.cc:407] Connection header received
0808 18:39:05.365979 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:05.365982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:05.366032 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:05.366111 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:05.366948 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.367704 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.369096 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:05.369444 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:05.369515 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:05.371536 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:05.371540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:05.371542 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:05.371565 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:05.373053 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.373443 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.373446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.373448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.373523 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:05.373816 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:05.373820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:05.373821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:05.374015 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:05.374087 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:05.374467 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 18:39:05.374580 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:06.325225 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.324781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:48987)
0808 18:39:06.325029 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.325115 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
W20260808 18:39:06.325570 15185 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.338979 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.338559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:36229)
0808 18:39:06.338780 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.338867 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":67,"threads_started":1}
I20260808 18:39:06.339254 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.338830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:36519)
0808 18:39:06.339061 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.339151 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
W20260808 18:39:06.339283 15382 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
W20260808 18:39:06.339533 14987 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.835770 15481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c4cdfba4abe4a8492f81506c656c19a)
I20260808 18:39:06.836020 15481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } }
I20260808 18:39:06.837075 15481 leader_election.cc:288] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591), 74e053c0634c47969d6e632cfa55b359 (127.4.61.253:41157)
I20260808 18:39:06.837846 15485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c4cdfba4abe4a8492f81506c656c19a)
I20260808 18:39:06.837877 15482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.837300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50686)
0808 18:39:06.837671 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.837761 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":37,"thread_start_us":73,"threads_started":1}
I20260808 18:39:06.837978 15485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } }
W20260808 18:39:06.838084 14728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.838979 15482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.838727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50692)
0808 18:39:06.838866 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.838913 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 18:39:06.838985 15487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.838619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50690)
0808 18:39:06.838816 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.838891 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":57,"threads_started":1}
W20260808 18:39:06.839075 14728 leader_election.cc:334] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591): Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
W20260808 18:39:06.839140 14461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.839321 15485 leader_election.cc:288] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591), 4f1169a67c834e209fb0193eff82483d (127.4.61.252:45237)
I20260808 18:39:06.840312 15487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.840053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50700)
0808 18:39:06.840154 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.840249 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:39:06.840408 14461 leader_election.cc:334] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591): Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.841877 15484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.837405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.4.61.253:41157)
0808 18:39:06.837655 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.837660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.837747 (+ 87us) server_negotiation.cc:407] Connection header received
0808 18:39:06.837942 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.837946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.838012 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.838092 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.838541 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.839324 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.840844 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.841356 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.841469 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.841538 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.841715 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.841787 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":184,"thread_start_us":65,"threads_started":1}
I20260808 18:39:06.841899 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.837300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:41157 (local address 127.0.0.1:58144)
0808 18:39:06.837645 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.837660 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.837797 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.838228 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.838231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.838254 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.838392 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.838400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.839451 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.839454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.840725 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.840736 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.841480 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.841484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.841582 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.841608 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.841685 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.841766 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":67,"threads_started":1}
I20260808 18:39:06.842414 14498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f1169a67c834e209fb0193eff82483d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "74e053c0634c47969d6e632cfa55b359" is_pre_election: true
I20260808 18:39:06.842615 14498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1169a67c834e209fb0193eff82483d in term 1.
I20260808 18:39:06.842965 14727 leader_election.cc:302] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1169a67c834e209fb0193eff82483d, 74e053c0634c47969d6e632cfa55b359; no voters: 4c4cdfba4abe4a8492f81506c656c19a
I20260808 18:39:06.843194 15481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 18:39:06.843262 15481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c4cdfba4abe4a8492f81506c656c19a)
I20260808 18:39:06.843302 15481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:39:06.843787 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.839395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56214 (local address 127.4.61.252:45237)
0808 18:39:06.839771 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.839779 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.839791 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:06.839829 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.839832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.839868 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.839978 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.840206 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.840848 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.842302 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.842782 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.842883 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.842940 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.843623 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.843691 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":114,"threads_started":1}
I20260808 18:39:06.843817 15489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.839007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:45237 (local address 127.0.0.1:56214)
0808 18:39:06.839489 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.839502 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.839585 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.839997 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.840000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.840018 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.840104 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.840110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.840949 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.840953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.842128 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.842138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.843373 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.843377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.843468 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.843494 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.843599 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.843674 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":19,"thread_start_us":63,"threads_started":1}
I20260808 18:39:06.844417 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "74e053c0634c47969d6e632cfa55b359" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4f1169a67c834e209fb0193eff82483d" is_pre_election: true
I20260808 18:39:06.844568 15481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } }
I20260808 18:39:06.844806 14753 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74e053c0634c47969d6e632cfa55b359 in current term 2: Already voted for candidate 4f1169a67c834e209fb0193eff82483d in this term.
I20260808 18:39:06.844950 15481 leader_election.cc:288] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 election: Requested vote from peers 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591), 74e053c0634c47969d6e632cfa55b359 (127.4.61.253:41157)
I20260808 18:39:06.845273 14454 leader_election.cc:302] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74e053c0634c47969d6e632cfa55b359; no voters: 4c4cdfba4abe4a8492f81506c656c19a, 4f1169a67c834e209fb0193eff82483d
I20260808 18:39:06.845355 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.845092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50714)
0808 18:39:06.845238 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.845296 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 18:39:06.845544 14498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f1169a67c834e209fb0193eff82483d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "74e053c0634c47969d6e632cfa55b359"
I20260808 18:39:06.845667 14498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:39:06.845963 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.845777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50718)
0808 18:39:06.845867 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.845914 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 18:39:06.846071 14728 leader_election.cc:334] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591): Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
I20260808 18:39:06.846786 14498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1169a67c834e209fb0193eff82483d in term 2.
I20260808 18:39:06.846894 15485 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:39:06.847071 14727 leader_election.cc:302] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1169a67c834e209fb0193eff82483d, 74e053c0634c47969d6e632cfa55b359; no voters: 4c4cdfba4abe4a8492f81506c656c19a
I20260808 18:39:06.847267 15481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 2 FOLLOWER]: Leader election won for term 2
I20260808 18:39:06.847458 15481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [term 2 LEADER]: Becoming Leader. State: Replica: 4f1169a67c834e209fb0193eff82483d, State: Running, Role: LEADER
I20260808 18:39:06.847724 15481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } }
I20260808 18:39:06.849076 15492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f1169a67c834e209fb0193eff82483d. Latest consensus state: current_term: 2 leader_uuid: "4f1169a67c834e209fb0193eff82483d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:06.849187 15492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:06.849514 15496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:06.851846 15496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:06.852229 15496 catalog_manager.cc:1259] Loaded cluster ID: 6d27ab38df7847c6b8f875c08988de51
I20260808 18:39:06.852273 15496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:06.852799 15496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:06.853170 15496 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Loaded TSK: 0
I20260808 18:39:06.853808 15496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:39:06.882478 14744 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:39:06.885607 14744 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:06.888585 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.888343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50736)
0808 18:39:06.888462 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.888514 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 18:39:06.888705 14498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [term 2 FOLLOWER]: Refusing update from remote peer 4f1169a67c834e209fb0193eff82483d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 18:39:06.889277 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.889077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.0.0.1:50740)
0808 18:39:06.889175 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.889219 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 18:39:06.889245 15492 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 18:39:06.889400 14728 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d -> Peer 4c4cdfba4abe4a8492f81506c656c19a (127.4.61.254:45591): Couldn't send request to peer 4c4cdfba4abe4a8492f81506c656c19a. Status: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 18:39:06.890755 15485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f1169a67c834e209fb0193eff82483d. Latest consensus state: current_term: 2 leader_uuid: "4f1169a67c834e209fb0193eff82483d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:06.890879 15485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:06.891870 15481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4f1169a67c834e209fb0193eff82483d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:06.891994 15481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:06.892199 15485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4f1169a67c834e209fb0193eff82483d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4c4cdfba4abe4a8492f81506c656c19a" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45591 } } peers { permanent_uuid: "74e053c0634c47969d6e632cfa55b359" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 41157 } attrs { promote: false } } peers { permanent_uuid: "4f1169a67c834e209fb0193eff82483d" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 45237 } attrs { promote: false } } }
I20260808 18:39:06.892320 15485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74e053c0634c47969d6e632cfa55b359 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:39:06.901906 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.897556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:46745 (local address 127.0.0.1:58218)
0808 18:39:06.897884 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.897900 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.897994 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.898546 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.898549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.898565 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.898656 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.898660 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.899536 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.899539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.900661 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.900670 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.901544 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.901547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.901637 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.901667 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.901714 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.901786 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242}
I20260808 18:39:06.902438 15505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.897661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.4.61.194:46745)
0808 18:39:06.898253 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.898258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.898272 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:06.898350 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.898362 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.898426 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.898755 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.898878 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.899431 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.900777 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.901415 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.902099 (+ 684us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.902170 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.902202 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.902273 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":67,"threads_started":1}
I20260808 18:39:06.902976 15482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.897798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36749 (local address 127.0.0.1:49986)
0808 18:39:06.897994 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.898008 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.898088 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.899775 (+ 1687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.899778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.899794 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.899871 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.899876 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.900559 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.900562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.901575 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.901585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.902603 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.902608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.902691 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.902716 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.902760 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.902825 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":20}
I20260808 18:39:06.903002 15088 tablet_service.cc:1467] Processing CreateTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 (DEFAULT_TABLE table=test-table [id=28ba8626aad946b9b3b60b66d106f30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:06.903184 15507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.898221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38951 (local address 127.0.0.1:43316)
0808 18:39:06.898883 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.898896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.898976 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.899382 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.899385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.899401 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.899506 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.899513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.900507 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.900511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.901667 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.901674 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.902744 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.902748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.902897 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.902923 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.902994 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.903063 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":29,"thread_start_us":124,"threads_started":1}
I20260808 18:39:06.903343 15088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 095bdf9362974a52a9f4b522c4c4d960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:06.903525 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.897923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.4.61.195:36749)
0808 18:39:06.899570 (+ 1647us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.899575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.899588 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:06.899636 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.899639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.899682 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.899750 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.899968 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.900469 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.901707 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.902471 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.903231 (+ 760us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.903298 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.903333 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.903405 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1568,"thread_start_us":85,"threads_started":1}
I20260808 18:39:06.903615 15509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.898598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43316 (local address 127.4.61.193:38951)
0808 18:39:06.899153 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.899157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.899168 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:39:06.899210 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.899212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.899270 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.899347 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.899614 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.900398 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.901781 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.902636 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.902731 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.902791 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.903403 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.903485 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":72,"threads_started":1}
I20260808 18:39:06.904016 15287 tablet_service.cc:1467] Processing CreateTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 (DEFAULT_TABLE table=test-table [id=28ba8626aad946b9b3b60b66d106f30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:06.904054 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 (DEFAULT_TABLE table=test-table [id=28ba8626aad946b9b3b60b66d106f30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:06.904301 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 095bdf9362974a52a9f4b522c4c4d960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:06.904311 15287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 095bdf9362974a52a9f4b522c4c4d960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:06.905597 15510 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Bootstrap starting.
I20260808 18:39:06.906654 15510 tablet_bootstrap.cc:654] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:06.907135 15513 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Bootstrap starting.
I20260808 18:39:06.908004 15513 tablet_bootstrap.cc:654] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:06.908010 15510 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: No bootstrap required, opened a new log
I20260808 18:39:06.908072 15510 ts_tablet_manager.cc:1397] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:39:06.908468 15510 raft_consensus.cc:348] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.908569 15510 raft_consensus.cc:374] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:06.908574 15514 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: Bootstrap starting.
I20260808 18:39:06.908599 15510 raft_consensus.cc:729] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddb6a48d0c54bf7bce0d8d7728c6691, State: Initialized, Role: FOLLOWER
I20260808 18:39:06.908710 15510 consensus_queue.cc:260] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.909024 15510 ts_tablet_manager.cc:1428] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:06.909916 15513 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: No bootstrap required, opened a new log
I20260808 18:39:06.910043 15513 ts_tablet_manager.cc:1397] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:39:06.910014 15521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.909355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:42013)
0808 18:39:06.909793 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.909853 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":93,"threads_started":1}
I20260808 18:39:06.910529 15513 raft_consensus.cc:348] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.910648 15513 raft_consensus.cc:374] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:06.910682 15513 raft_consensus.cc:729] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512cf31132ca4e2299f3c2864bb53dd6, State: Initialized, Role: FOLLOWER
I20260808 18:39:06.910820 15513 consensus_queue.cc:260] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.911239 15513 ts_tablet_manager.cc:1428] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:06.911711 15514 tablet_bootstrap.cc:654] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:06.911743 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.910547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:44639)
0808 18:39:06.911593 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.911651 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":983,"thread_start_us":92,"threads_started":1}
I20260808 18:39:06.911760 15183 heartbeater.cc:503] Master 127.4.61.252:45237 was elected leader, sending a full tablet report...
I20260808 18:39:06.912878 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.912510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:55963)
0808 18:39:06.912736 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.912791 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":87,"threads_started":1}
I20260808 18:39:06.913652 15514 tablet_bootstrap.cc:492] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: No bootstrap required, opened a new log
I20260808 18:39:06.913743 15514 ts_tablet_manager.cc:1397] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 18:39:06.914179 15514 raft_consensus.cc:348] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.914276 15514 raft_consensus.cc:374] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:06.914299 15514 raft_consensus.cc:729] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2608011434474099afa9bb739d425c33, State: Initialized, Role: FOLLOWER
I20260808 18:39:06.914429 15514 consensus_queue.cc:260] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.914716 15514 ts_tablet_manager.cc:1428] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:06.914990 15381 heartbeater.cc:503] Master 127.4.61.252:45237 was elected leader, sending a full tablet report...
I20260808 18:39:06.915894 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.915689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:47325)
0808 18:39:06.915779 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.915829 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 18:39:06.916292 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.915016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:35771)
0808 18:39:06.916132 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.916191 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":89,"threads_started":1}
I20260808 18:39:06.916920 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.916674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:40315)
0808 18:39:06.916810 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.916857 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 18:39:06.916953 14986 heartbeater.cc:503] Master 127.4.61.252:45237 was elected leader, sending a full tablet report...
W20260808 18:39:06.940876 15188 tablet.cc:2369] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:39:06.947841 15520 raft_consensus.cc:482] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:06.947974 15520 raft_consensus.cc:504] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.949069 15520 leader_election.cc:288] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749), 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:06.953976 15521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.949287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36749 (local address 127.4.61.194:59113)
0808 18:39:06.949481 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.949497 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.949617 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.950138 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.950141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.950166 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.950296 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.950303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.951542 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.951545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.952818 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.952829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.953581 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.953584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.953655 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.953678 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.953728 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.953790 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 18:39:06.953975 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.949395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:59113 (local address 127.4.61.195:36749)
0808 18:39:06.949761 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.949766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.949784 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:39:06.949859 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.949862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.949918 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.950003 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.950559 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.951437 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.952941 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.953450 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.953570 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.953625 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.953766 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.953844 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 18:39:06.954387 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.949324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38951 (local address 127.4.61.194:58865)
0808 18:39:06.950418 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.950432 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:06.950520 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:06.950776 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:06.950780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:06.950799 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:06.950931 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.950938 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.952061 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.952064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.953196 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:06.953207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.953992 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.953996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:06.954097 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.954123 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:39:06.954185 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 18:39:06.954244 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017}
I20260808 18:39:06.954579 15509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.949536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:58865 (local address 127.4.61.193:38951)
0808 18:39:06.949725 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.949730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.950510 (+ 780us) server_negotiation.cc:407] Connection header received
0808 18:39:06.950604 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.950608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.950658 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.951045 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:06.951158 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.951889 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.953318 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.953857 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.953975 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.954227 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.954280 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.954381 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 18:39:06.954730 15316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "095bdf9362974a52a9f4b522c4c4d960" candidate_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512cf31132ca4e2299f3c2864bb53dd6" is_pre_election: true
I20260808 18:39:06.955017 15316 raft_consensus.cc:2454] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddb6a48d0c54bf7bce0d8d7728c6691 in term 0.
I20260808 18:39:06.955024 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "095bdf9362974a52a9f4b522c4c4d960" candidate_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2608011434474099afa9bb739d425c33" is_pre_election: true
I20260808 18:39:06.955180 14926 raft_consensus.cc:2454] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddb6a48d0c54bf7bce0d8d7728c6691 in term 0.
I20260808 18:39:06.955518 15023 leader_election.cc:302] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 512cf31132ca4e2299f3c2864bb53dd6, 6ddb6a48d0c54bf7bce0d8d7728c6691; no voters:
I20260808 18:39:06.955803 15520 raft_consensus.cc:2781] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:06.955868 15520 raft_consensus.cc:482] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:06.955895 15520 raft_consensus.cc:3037] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:06.956903 15520 raft_consensus.cc:504] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.957252 15520 leader_election.cc:288] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [CANDIDATE]: Term 1 election: Requested vote from peers 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749), 2608011434474099afa9bb739d425c33 (127.4.61.193:38951)
I20260808 18:39:06.957609 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "095bdf9362974a52a9f4b522c4c4d960" candidate_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2608011434474099afa9bb739d425c33"
I20260808 18:39:06.957728 14926 raft_consensus.cc:3037] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:06.957713 15316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "095bdf9362974a52a9f4b522c4c4d960" candidate_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512cf31132ca4e2299f3c2864bb53dd6"
I20260808 18:39:06.957865 15316 raft_consensus.cc:3037] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:06.958773 14926 raft_consensus.cc:2454] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddb6a48d0c54bf7bce0d8d7728c6691 in term 1.
I20260808 18:39:06.958853 15316 raft_consensus.cc:2454] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddb6a48d0c54bf7bce0d8d7728c6691 in term 1.
I20260808 18:39:06.959075 15024 leader_election.cc:302] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2608011434474099afa9bb739d425c33, 6ddb6a48d0c54bf7bce0d8d7728c6691; no voters:
I20260808 18:39:06.959300 15520 raft_consensus.cc:2781] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:06.959544 15520 raft_consensus.cc:686] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 LEADER]: Becoming Leader. State: Replica: 6ddb6a48d0c54bf7bce0d8d7728c6691, State: Running, Role: LEADER
I20260808 18:39:06.959800 15520 consensus_queue.cc:237] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } }
I20260808 18:39:06.960268 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.960029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:55409)
0808 18:39:06.960140 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.960200 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 18:39:06.962445 14743 catalog_manager.cc:5495] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194). New cstate: current_term: 1 leader_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ddb6a48d0c54bf7bce0d8d7728c6691" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 } health_report { overall_health: UNKNOWN } } }
W20260808 18:39:06.978571 14989 tablet.cc:2369] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:39:06.984617 15505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.981438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58230 (local address 127.4.61.194:46745)
0808 18:39:06.981561 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:06.981564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:06.981577 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:06.981653 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:06.981655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:06.981711 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:06.981802 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:06.981991 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.982536 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.983318 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:06.983545 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:06.983625 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:06.983808 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:06.984251 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:06.984332 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:06.984460 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 18:39:06.984508 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:39:06.987378 14926 raft_consensus.cc:1261] T 095bdf9362974a52a9f4b522c4c4d960 P 2608011434474099afa9bb739d425c33 [term 1 FOLLOWER]: Refusing update from remote peer 6ddb6a48d0c54bf7bce0d8d7728c6691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:06.987620 15316 raft_consensus.cc:1261] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Refusing update from remote peer 6ddb6a48d0c54bf7bce0d8d7728c6691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:06.987879 15520 consensus_queue.cc:1035] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2608011434474099afa9bb739d425c33" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:06.988191 15531 consensus_queue.cc:1035] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "512cf31132ca4e2299f3c2864bb53dd6" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:06.989666 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.989329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:42685)
0808 18:39:06.989525 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.989588 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260808 18:39:06.990052 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.989781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:59553)
0808 18:39:06.989936 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.989988 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 18:39:06.994112 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.993772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.195:35763)
0808 18:39:06.993988 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.994043 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 18:39:06.994371 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.994117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.193:56599)
0808 18:39:06.994223 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.994278 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 18:39:06.996654 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.996387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:57929)
0808 18:39:06.996531 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.996582 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 18:39:06.997464 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:06.997233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45591 (local address 127.4.61.194:57319)
0808 18:39:06.997361 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:06.997411 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:45591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 18:39:07.001605 14743 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:07.001773 14743 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:07.006410 14743 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f1169a67c834e209fb0193eff82483d: Sending DeleteTablet for 3 replicas of tablet 095bdf9362974a52a9f4b522c4c4d960
I20260808 18:39:07.007093 15287 tablet_service.cc:1514] Processing DeleteTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:06 UTC) from {username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:49986
I20260808 18:39:07.007093 15088 tablet_service.cc:1514] Processing DeleteTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:06 UTC) from {username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:58218
I20260808 18:39:07.007673 15552 tablet_replica.cc:330] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: stopping tablet replica
I20260808 18:39:07.007786 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 095bdf9362974a52a9f4b522c4c4d960 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:06 UTC) from {username='oryx', principal='oryx/127.4.61.252@KRBTEST.COM'} at 127.0.0.1:43316
I20260808 18:39:07.007838 15552 raft_consensus.cc:2229] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:07.008095 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 14693
I20260808 18:39:07.014360 15552 raft_consensus.cc:2258] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:07.014914 15556 tablet_replica.cc:330] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: stopping tablet replica
I20260808 18:39:07.015190 15556 raft_consensus.cc:2229] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:07.015434 15556 raft_consensus.cc:2258] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:07.017208 15556 ts_tablet_manager.cc:1905] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:07.019932 15556 ts_tablet_manager.cc:1918] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:07.020098 15556 log.cc:1196] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/095bdf9362974a52a9f4b522c4c4d960
I20260808 18:39:07.020483 15556 ts_tablet_manager.cc:1939] T 095bdf9362974a52a9f4b522c4c4d960 P 512cf31132ca4e2299f3c2864bb53dd6: Deleting consensus metadata
I20260808 18:39:07.020555 15552 ts_tablet_manager.cc:1905] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:07.023253 15552 ts_tablet_manager.cc:1918] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:07.023344 15552 log.cc:1196] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/095bdf9362974a52a9f4b522c4c4d960
I20260808 18:39:07.023604 15552 ts_tablet_manager.cc:1939] T 095bdf9362974a52a9f4b522c4c4d960 P 6ddb6a48d0c54bf7bce0d8d7728c6691: Deleting consensus metadata
I20260808 18:39:07.024441 14725 catalog_manager.cc:4841] TS 6ddb6a48d0c54bf7bce0d8d7728c6691 (127.4.61.194:46745): tablet 095bdf9362974a52a9f4b522c4c4d960 (table test-table [id=28ba8626aad946b9b3b60b66d106f30c]) successfully deleted
I20260808 18:39:07.025786 14727 catalog_manager.cc:4841] TS 512cf31132ca4e2299f3c2864bb53dd6 (127.4.61.195:36749): tablet 095bdf9362974a52a9f4b522c4c4d960 (table test-table [id=28ba8626aad946b9b3b60b66d106f30c]) successfully deleted
W20260808 18:39:07.026291 15507 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:07.025962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38951 (local address 127.0.0.1:43330)
0808 18:39:07.026131 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:07.026182 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:38951: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 18:39:07.026391 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 14996
W20260808 18:39:07.026535 14728 catalog_manager.cc:4584] TS 2608011434474099afa9bb739d425c33 (127.4.61.193:38951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 095bdf9362974a52a9f4b522c4c4d960: Network error: Client connection negotiation failed: client connection to 127.4.61.193:38951: connect: Connection reset by peer (error 104)
I20260808 18:39:07.040480 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 15193
I20260808 18:39:07.057734 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 14273
I20260808 18:39:07.071250 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 14429
2026-08-08T18:39:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5413 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:07 dist-test-slave-fgb3 krb5kdc[15561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:07 dist-test-slave-fgb3 krb5kdc[15561](info): set up 2 sockets
Aug 08 18:39:07 dist-test-slave-fgb3 krb5kdc[15561](info): commencing operation
krb5kdc: starting...
W20260808 18:39:08.215773 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab.
Entry for principal oryx/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab.
I20260808 18:39:08.338835 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34245
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab
--principal=oryx/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:34245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:08.450129 15578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:08.450399 15578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:08.450441 15578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:08.454267 15578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:08.454332 15578 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 18:39:08.454349 15578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:08.454365 15578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:08.454392 15578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:08.454406 15578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:08.459470 15578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:34245
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.254.keytab
--principal=oryx/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:08.460387 15578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:08.461308 15578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:08.469409 15586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:08.469414 15588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:08.469419 15590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:08.469523 15578 server_base.cc:1034] running on GCE node
I20260808 18:39:08.470139 15578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:08.471167 15578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:08.472334 15578 hybrid_clock.cc:648] HybridClock initialized: now 1786214348472318 us; error 26 us; skew 500 ppm
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:08.477665 15578 init.cc:377] Logged in from keytab as oryx/127.4.61.254@KRBTEST.COM (short username oryx)
I20260808 18:39:08.478609 15578 webserver.cc:460] Webserver started at http://127.4.61.254:35843/ using document root <none> and password file <none>
I20260808 18:39:08.479146 15578 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:08.479211 15578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:08.479420 15578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:08.481428 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "f956064369bd4d8a812f343259f4ac4d"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "83589712306757be02d56680638edac1"
server_key_iv: "a69c3f503a059ed26ca190371703199d"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.481967 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "f956064369bd4d8a812f343259f4ac4d"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "83589712306757be02d56680638edac1"
server_key_iv: "a69c3f503a059ed26ca190371703199d"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.485618 15578 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:39:08.487955 15603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:08.489096 15578 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:08.489209 15578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "f956064369bd4d8a812f343259f4ac4d"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "83589712306757be02d56680638edac1"
server_key_iv: "a69c3f503a059ed26ca190371703199d"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.489301 15578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:08.505066 15578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:08.508299 15578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:08.508488 15578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:08.516407 15578 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:34245
I20260808 18:39:08.516430 15695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:34245 every 8 connection(s)
I20260808 18:39:08.517350 15578 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:08.520134 15696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:08.525405 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 15578
I20260808 18:39:08.525542 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:08.525790 15696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Bootstrap starting.
I20260808 18:39:08.525882 4343 external_mini_cluster.cc:1428] Setting key a972bd381a4d7d9428ff4caa49a4f0eb
I20260808 18:39:08.528385 15696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:08.529109 15696 log.cc:824] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:08.530946 15696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: No bootstrap required, opened a new log
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:08.534348 15696 raft_consensus.cc:348] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } }
I20260808 18:39:08.534610 15696 raft_consensus.cc:374] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:08.534672 15696 raft_consensus.cc:729] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f956064369bd4d8a812f343259f4ac4d, State: Initialized, Role: FOLLOWER
I20260808 18:39:08.535171 15696 consensus_queue.cc:260] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } }
I20260808 18:39:08.535328 15696 raft_consensus.cc:388] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:08.535403 15696 raft_consensus.cc:482] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:08.535511 15696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:08.536600 15696 raft_consensus.cc:504] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } }
I20260808 18:39:08.536983 15696 leader_election.cc:302] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f956064369bd4d8a812f343259f4ac4d; no voters:
I20260808 18:39:08.537303 15696 leader_election.cc:288] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:08.537423 15706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:08.537654 15706 raft_consensus.cc:686] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [term 1 LEADER]: Becoming Leader. State: Replica: f956064369bd4d8a812f343259f4ac4d, State: Running, Role: LEADER
I20260808 18:39:08.537992 15706 consensus_queue.cc:237] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } }
I20260808 18:39:08.538707 15696 sys_catalog.cc:564] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:08.540028 15707 sys_catalog.cc:455] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f956064369bd4d8a812f343259f4ac4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } } }
I20260808 18:39:08.540170 15707 sys_catalog.cc:458] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:08.541059 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.527302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34586 (local address 127.4.61.254:34245)
0808 18:39:08.527751 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:08.527765 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:08.527801 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:39:08.528447 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:08.528470 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:08.528823 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:08.529139 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:08.529931 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.530950 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.531796 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.532273 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.532419 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:08.534874 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:08.534881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:08.534898 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:08.534929 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:08.536796 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.537328 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.537334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.537340 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.537484 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.537805 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.537808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.537809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.538392 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:08.538592 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:08.539412 (+ 820us) server_negotiation.cc:299] Negotiation successful
0808 18:39:08.539748 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":131,"threads_started":1}
I20260808 18:39:08.541038 15709 sys_catalog.cc:455] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f956064369bd4d8a812f343259f4ac4d. Latest consensus state: current_term: 1 leader_uuid: "f956064369bd4d8a812f343259f4ac4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f956064369bd4d8a812f343259f4ac4d" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34245 } } }
I20260808 18:39:08.541410 15709 sys_catalog.cc:458] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d [sys.catalog]: This master's current role is: LEADER
W20260808 18:39:08.544231 15727 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:39:08.544307 15727 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:39:08.544374 15718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:08.545080 15718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:08.550177 15718 catalog_manager.cc:1347] Generated new cluster ID: 423b34747aaf4734a6b7b8b4ba416614
I20260808 18:39:08.550240 15718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:08.555516 15718 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:08.556654 15718 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:08.565740 15718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Generated new TSK 0
I20260808 18:39:08.566644 15718 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
I20260808 18:39:08.603248 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34245
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:08.715692 15733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:08.715943 15733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:08.716005 15733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:08.719895 15733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:08.719950 15733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:08.720002 15733 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:39:08.720055 15733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:08.725051 15733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:08.726078 15733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:08.727144 15733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:08.736299 15740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:08.736318 15739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:08.736318 15749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:08.736511 15733 server_base.cc:1034] running on GCE node
I20260808 18:39:08.737035 15733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:08.737649 15733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:08.738768 15733 hybrid_clock.cc:648] HybridClock initialized: now 1786214348738752 us; error 33 us; skew 500 ppm
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:08.741480 15733 init.cc:377] Logged in from keytab as oryx/127.4.61.193@KRBTEST.COM (short username oryx)
I20260808 18:39:08.742358 15733 webserver.cc:460] Webserver started at http://127.4.61.193:41667/ using document root <none> and password file <none>
I20260808 18:39:08.742904 15733 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:08.742972 15733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:08.743177 15733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:08.745195 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "7bf7b2b68a2f439689f183ad5a177ca7"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "3c41188543d756629c3ad0f99722ab35"
server_key_iv: "4f89479076dbed243c602ba002e62470"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.745757 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "7bf7b2b68a2f439689f183ad5a177ca7"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "3c41188543d756629c3ad0f99722ab35"
server_key_iv: "4f89479076dbed243c602ba002e62470"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.749394 15733 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 18:39:08.751885 15759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:08.753111 15733 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:08.753235 15733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "7bf7b2b68a2f439689f183ad5a177ca7"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "3c41188543d756629c3ad0f99722ab35"
server_key_iv: "4f89479076dbed243c602ba002e62470"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.753364 15733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:08.778388 15733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:08.781313 15733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:08.781497 15733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:08.783046 15733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:08.783098 15733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:08.783155 15733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:08.783180 15733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:08.793668 15733 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:38933
I20260808 18:39:08.793716 15926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:38933 every 8 connection(s)
I20260808 18:39:08.794845 15733 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:08.796530 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.783889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51315 (local address 127.4.61.254:34245)
0808 18:39:08.784026 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:08.784030 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:08.785030 (+ 1000us) server_negotiation.cc:407] Connection header received
0808 18:39:08.786039 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:08.786043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:08.786104 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:08.786162 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:08.787593 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.788404 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.789611 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.789978 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.790095 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:08.792966 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:08.792970 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:08.792973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:08.793003 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:08.794612 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.795124 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.795128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.795130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.795232 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.795608 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.795612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.795614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.795810 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:08.795891 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:08.796300 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 18:39:08.796403 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 18:39:08.797283 15769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.784404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.193:51315)
0808 18:39:08.784887 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:08.784929 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:08.785783 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:08.786579 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:08.786585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:08.786902 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:08.787428 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:08.787453 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.788548 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.788552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:08.789482 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:08.789492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.790151 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.790156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:08.790373 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:08.790927 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:08.790946 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:08.792796 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:08.794717 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:08.794722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:08.794735 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:08.795024 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:08.795348 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:08.795351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:08.795353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:08.795516 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:08.795885 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:08.795890 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:08.796115 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 18:39:08.796264 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 18:39:08.796509 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":137,"threads_started":1}
I20260808 18:39:08.798624 15927 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34245
I20260808 18:39:08.798785 15927 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:08.799274 15927 heartbeater.cc:511] Master 127.4.61.254:34245 requested a full tablet report, sending...
I20260808 18:39:08.800074 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 15733
I20260808 18:39:08.800225 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:08.800503 4343 external_mini_cluster.cc:1428] Setting key 166b32af69fd7c48b610fad3bd08811f
I20260808 18:39:08.800989 15628 ts_manager.cc:194] Registered new tserver with Master: 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933)
I20260808 18:39:08.802423 15628 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:51315
I20260808 18:39:08.808158 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.800751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:50719 (local address 127.4.61.254:34245)
0808 18:39:08.800856 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:08.800859 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:08.801299 (+ 440us) server_negotiation.cc:407] Connection header received
0808 18:39:08.801397 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:08.801400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:08.801441 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:08.801518 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:08.802035 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.802758 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.803860 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.804143 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.804319 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:08.805346 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:08.805349 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:08.805352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:08.805376 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:08.806598 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.807084 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.807087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.807089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.807181 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:08.807468 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:08.807471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:08.807472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:08.807630 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:08.807703 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:08.807961 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 18:39:08.808048 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:39:08.808274 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.800676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.193:50719)
0808 18:39:08.801215 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:08.801230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:08.801324 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:08.801545 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:08.801548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:08.801753 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:08.801872 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:08.801879 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.802906 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.802910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:08.803724 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:08.803736 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:08.804327 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:08.804330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:08.804428 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:08.804880 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:08.804890 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:08.805215 (+ 325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:08.806698 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:08.806702 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:08.806704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:08.806993 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:08.807276 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:08.807279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:08.807281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:08.807382 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:08.807714 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:08.807718 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:08.807814 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 18:39:08.807929 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 18:39:08.808078 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for oryx/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
I20260808 18:39:08.829286 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34245
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:08.940979 15938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:08.941222 15938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:08.941265 15938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:08.945175 15938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:08.945230 15938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:08.945266 15938 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:39:08.945297 15938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:08.950368 15938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:08.951356 15938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:08.952316 15938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:08.962361 15945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:08.962455 15938 server_base.cc:1034] running on GCE node
W20260808 18:39:08.962334 15949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:08.962607 15944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:08.962997 15938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:08.963569 15938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:08.964721 15938 hybrid_clock.cc:648] HybridClock initialized: now 1786214348964707 us; error 25 us; skew 500 ppm
Aug 08 18:39:08 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:08.967343 15938 init.cc:377] Logged in from keytab as oryx/127.4.61.194@KRBTEST.COM (short username oryx)
I20260808 18:39:08.968181 15938 webserver.cc:460] Webserver started at http://127.4.61.194:36433/ using document root <none> and password file <none>
I20260808 18:39:08.968713 15938 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:08.968775 15938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:08.968981 15938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:08.971079 15938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "bb7204b1604647a29e83fdaf00541c80"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "ac7c14c73a128666898eb6806573e724"
server_key_iv: "8ef023af715f2caeb9fb868f4acb8b73"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.971710 15938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "bb7204b1604647a29e83fdaf00541c80"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "ac7c14c73a128666898eb6806573e724"
server_key_iv: "8ef023af715f2caeb9fb868f4acb8b73"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.975440 15938 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 18:39:08.977748 15958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:08.978937 15938 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:39:08.979045 15938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "bb7204b1604647a29e83fdaf00541c80"
format_stamp: "Formatted at 2026-08-08 18:39:08 on dist-test-slave-fgb3"
server_key: "ac7c14c73a128666898eb6806573e724"
server_key_iv: "8ef023af715f2caeb9fb868f4acb8b73"
server_key_version: "encryptionkey@0"
I20260808 18:39:08.979137 15938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:08.992169 15938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:08.995312 15938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:08.995492 15938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:08.996948 15938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:08.997011 15938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:08.997071 15938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:08.997097 15938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:09.006598 15938 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:44805
I20260808 18:39:09.006664 16130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:44805 every 8 connection(s)
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:09.007607 15938 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:09.010648 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.997736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:58275 (local address 127.4.61.254:34245)
0808 18:39:08.997844 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:08.997847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:08.998989 (+ 1142us) server_negotiation.cc:407] Connection header received
0808 18:39:09.000116 (+ 1127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.000120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.000181 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.000238 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.001932 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.002776 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.004282 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.004625 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.004748 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.007483 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.007487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.007490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.007521 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.008972 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.009398 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.009401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.009402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.009493 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.009730 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.009731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.009732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.009883 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.009950 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.010370 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.010498 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 18:39:09.011368 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:08.998279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.194:58275)
0808 18:39:08.998854 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:08.998898 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:08.999867 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.000662 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.000672 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.001064 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:09.001743 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.001763 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.002899 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.002902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.004150 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.004160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.004789 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.004794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.005029 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.005664 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:09.005685 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:09.007294 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:09.009062 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.009066 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.009077 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.009305 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.009558 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.009560 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.009561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.009676 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.009948 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:09.009952 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:09.010158 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.010302 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.010587 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":142,"threads_started":1}
I20260808 18:39:09.012493 16131 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34245
I20260808 18:39:09.012626 16131 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:09.013115 16131 heartbeater.cc:511] Master 127.4.61.254:34245 requested a full tablet report, sending...
I20260808 18:39:09.014099 15629 ts_manager.cc:194] Registered new tserver with Master: bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:09.014791 15629 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:58275
I20260808 18:39:09.015373 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 15938
I20260808 18:39:09.015496 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:09.015831 4343 external_mini_cluster.cc:1428] Setting key 86563eed1038ac4ca3a49caa4f59cd0e
I20260808 18:39:09.021405 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.014424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.194:41111)
0808 18:39:09.014680 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.014691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.014780 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.015060 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.015063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.015260 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:09.015376 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.015383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.016430 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.016439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.017196 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.017208 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.017624 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.017627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.017718 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.018163 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:09.018174 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:09.018512 (+ 338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:09.020023 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.020026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.020029 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.020211 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.020481 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.020483 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.020485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.020566 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.021005 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:09.021007 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:09.021078 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.021149 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.021254 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":105,"threads_started":1}
I20260808 18:39:09.021464 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.014472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:41111 (local address 127.4.61.254:34245)
0808 18:39:09.014573 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.014577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.014754 (+ 177us) server_negotiation.cc:407] Connection header received
0808 18:39:09.014888 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.014892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.014949 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.015017 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.015572 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.016306 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.017315 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.017530 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.017613 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.018638 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.018641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.018644 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.018668 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.019913 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.020297 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.020300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.020302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.020386 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.020648 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.020651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.020653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.020915 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.021024 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.021214 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.021323 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
WARNING: no policy specified for oryx/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
I20260808 18:39:09.045326 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34245
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:09.159353 16142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:09.159597 16142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:09.159659 16142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:09.163625 16142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:09.163684 16142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:09.163738 16142 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 18:39:09.163789 16142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:09.168905 16142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.61.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:09.169957 16142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:09.170974 16142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:09.180318 16152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:09.180322 16148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:09.180313 16149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:09.180622 16142 server_base.cc:1034] running on GCE node
I20260808 18:39:09.181061 16142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:09.181651 16142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:09.182783 16142 hybrid_clock.cc:648] HybridClock initialized: now 1786214349182761 us; error 28 us; skew 500 ppm
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:09.185329 16142 init.cc:377] Logged in from keytab as oryx/127.4.61.195@KRBTEST.COM (short username oryx)
I20260808 18:39:09.186184 16142 webserver.cc:460] Webserver started at http://127.4.61.195:39037/ using document root <none> and password file <none>
I20260808 18:39:09.186757 16142 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:09.186825 16142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:09.187023 16142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:09.189039 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "fbb85a035e1e460c9370dd328caeda46"
format_stamp: "Formatted at 2026-08-08 18:39:09 on dist-test-slave-fgb3"
server_key: "74fb279af8b529454e3dddf72f30a593"
server_key_iv: "53947520cb3bd0de3ecd0ae411476031"
server_key_version: "encryptionkey@0"
I20260808 18:39:09.189662 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "fbb85a035e1e460c9370dd328caeda46"
format_stamp: "Formatted at 2026-08-08 18:39:09 on dist-test-slave-fgb3"
server_key: "74fb279af8b529454e3dddf72f30a593"
server_key_iv: "53947520cb3bd0de3ecd0ae411476031"
server_key_version: "encryptionkey@0"
I20260808 18:39:09.193322 16142 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:39:09.195660 16164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:09.196791 16142 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:09.196900 16142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "fbb85a035e1e460c9370dd328caeda46"
format_stamp: "Formatted at 2026-08-08 18:39:09 on dist-test-slave-fgb3"
server_key: "74fb279af8b529454e3dddf72f30a593"
server_key_iv: "53947520cb3bd0de3ecd0ae411476031"
server_key_version: "encryptionkey@0"
I20260808 18:39:09.196992 16142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:09.208146 16142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:09.211089 16142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:09.211274 16142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:09.212841 16142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:09.212893 16142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:09.212950 16142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:09.212980 16142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:09.223754 16142 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:38149
I20260808 18:39:09.224543 16353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:38149 every 8 connection(s)
I20260808 18:39:09.224819 16142 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:09.226198 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.213647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:51397 (local address 127.4.61.254:34245)
0808 18:39:09.213783 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.213786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.214810 (+ 1024us) server_negotiation.cc:407] Connection header received
0808 18:39:09.215879 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.215884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.215947 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.216004 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.217415 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.218061 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.219249 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.219476 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.219567 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.222493 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.222498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.222501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.222534 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.224075 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.224695 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.224699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.224701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.224783 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.225121 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.225125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.225126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.225343 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.225437 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.225972 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.226076 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 18:39:09.226998 16179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.214154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.195:51397)
0808 18:39:09.214667 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.214708 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.215600 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.216400 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.216407 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.216725 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:09.217252 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.217274 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.218184 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.218188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.219129 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.219139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.219634 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.219638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.219835 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.220457 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:09.220479 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:09.222283 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:09.224184 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.224188 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.224200 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.224556 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.224869 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.224872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.224874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.225022 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.225490 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:09.225496 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:09.225737 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.225892 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.226133 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":172,"threads_started":1}
I20260808 18:39:09.228137 16354 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34245
I20260808 18:39:09.228278 16354 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:09.228760 16354 heartbeater.cc:511] Master 127.4.61.254:34245 requested a full tablet report, sending...
I20260808 18:39:09.229763 15628 ts_manager.cc:194] Registered new tserver with Master: fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149)
I20260808 18:39:09.230535 15628 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:51397
I20260808 18:39:09.232292 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 16142
I20260808 18:39:09.232434 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:09.232765 4343 external_mini_cluster.cc:1428] Setting key 5ed10db0d29f036f6417f7dd051a8fb9
I20260808 18:39:09.234867 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:39:09.236914 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.230201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:40817 (local address 127.4.61.254:34245)
0808 18:39:09.230304 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.230307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.230530 (+ 223us) server_negotiation.cc:407] Connection header received
0808 18:39:09.230669 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.230672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.230717 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.230781 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.231213 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.231702 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.232673 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.232921 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.233000 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.234033 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.234037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.234040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.234066 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.235482 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.235862 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.235865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.235867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.235941 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.236177 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.236181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.236182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.236346 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.236431 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.236664 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.236761 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 18:39:09.236925 16365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.230131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.4.61.195:40817)
0808 18:39:09.230455 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.230470 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.230567 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.230827 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.230830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.231017 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:09.231109 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.231114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.231819 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.231823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.232556 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.232568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.233027 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.233031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.233125 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.233616 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:09.233627 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:09.233931 (+ 304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:09.235586 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.235589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.235592 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.235768 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.236021 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.236024 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.236026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.236097 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.236433 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:09.236436 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:09.236519 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.236602 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.236741 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":90,"threads_started":1}
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 18:39:09.259649 15702 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:09.253707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.4.61.254:34245)
0808 18:39:09.253830 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.253834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.253847 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:09.253905 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.253907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.253950 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.254020 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.254726 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.255252 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.256051 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.256255 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.256322 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.259472 (+ 3150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34592: BlockingRecv error: recv got EOF from 127.0.0.1:34592 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:09.268373 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.261261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34596 (local address 127.4.61.254:34245)
0808 18:39:09.261402 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.261407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.261506 (+ 99us) server_negotiation.cc:407] Connection header received
0808 18:39:09.261606 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.261609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.261651 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.261725 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.262261 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.262806 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.263552 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.263755 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.263833 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.265849 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.265859 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.265861 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.265882 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.267147 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.267479 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.267481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.267482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.267545 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.267718 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.267720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.267721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.267880 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.267974 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.268135 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.268218 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 18:39:09.271072 15628 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:39:09.274080 15628 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:09.288929 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.283723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51986 (local address 127.4.61.194:44805)
0808 18:39:09.284433 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.284444 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.284461 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:39:09.284522 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.284525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.284662 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.284810 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.285250 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286016 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.287508 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.288256 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288353 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.288535 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.288685 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.288783 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":127,"threads_started":1}
I20260808 18:39:09.289036 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.282988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:38149 (local address 127.0.0.1:59704)
0808 18:39:09.283367 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.283423 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.283559 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.284860 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.284862 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.284887 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.285163 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.285171 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286673 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.286676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.287655 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.287664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.288600 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.288702 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.288729 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.288779 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.288847 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":116,"spinlock_wait_cycles":3456,"thread_start_us":75,"threads_started":1}
I20260808 18:39:09.288924 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.283371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:44805 (local address 127.0.0.1:51986)
0808 18:39:09.283972 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.283985 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.284077 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.284820 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.284827 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.284854 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.285129 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.285139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286127 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.286130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.287354 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.287366 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.288375 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.288486 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.288526 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.288633 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.288764 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":80,"thread_start_us":103,"threads_started":1}
I20260808 18:39:09.289413 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.283143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59704 (local address 127.4.61.195:38149)
0808 18:39:09.284330 (+ 1187us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.284342 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.284373 (+ 31us) server_negotiation.cc:407] Connection header received
0808 18:39:09.284452 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.284457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.284717 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.285020 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.285293 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286535 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.287766 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.288462 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288996 (+ 534us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.289140 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.289186 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.289271 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1079,"thread_start_us":165,"threads_started":1}
I20260808 18:39:09.291931 16248 tablet_service.cc:1467] Processing CreateTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 (DEFAULT_TABLE table=test-table [id=545e7039296440e2beb8ba21c00b0abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.291946 16027 tablet_service.cc:1467] Processing CreateTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 (DEFAULT_TABLE table=test-table [id=545e7039296440e2beb8ba21c00b0abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.292887 16248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51937f28abf34deb960b253ca4b3a3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.292878 16027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51937f28abf34deb960b253ca4b3a3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.298202 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.283948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43630 (local address 127.4.61.193:38933)
0808 18:39:09.284315 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.284330 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.284356 (+ 26us) server_negotiation.cc:407] Connection header received
0808 18:39:09.284434 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.284440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.284650 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.284810 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.285293 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286492 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288033 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.288799 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.288887 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.289044 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.297918 (+ 8874us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.298055 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":75,"threads_started":1}
I20260808 18:39:09.289472 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.283756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.0.0.1:43630)
0808 18:39:09.284037 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.284048 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.284111 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.284974 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.284978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.284996 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.285157 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.285164 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.286615 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.286618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.287912 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.287922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.289108 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.289111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.289206 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.289227 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.289291 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.289352 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":230,"thread_start_us":97,"threads_started":1}
I20260808 18:39:09.299898 16398 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Bootstrap starting.
I20260808 18:39:09.300302 16399 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Bootstrap starting.
I20260808 18:39:09.301178 15825 tablet_service.cc:1467] Processing CreateTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 (DEFAULT_TABLE table=test-table [id=545e7039296440e2beb8ba21c00b0abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.302174 15825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51937f28abf34deb960b253ca4b3a3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.302304 16399 tablet_bootstrap.cc:654] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.303041 16399 log.cc:824] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:09.305088 16399 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: No bootstrap required, opened a new log
I20260808 18:39:09.305248 16398 tablet_bootstrap.cc:654] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.305291 16399 ts_tablet_manager.cc:1397] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:39:09.305913 16398 log.cc:824] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:09.307499 16398 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: No bootstrap required, opened a new log
I20260808 18:39:09.307672 16398 ts_tablet_manager.cc:1397] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 18:39:09.308928 16402 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Bootstrap starting.
I20260808 18:39:09.309176 16399 raft_consensus.cc:348] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.309450 16399 raft_consensus.cc:374] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.309512 16399 raft_consensus.cc:729] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.309927 16399 consensus_queue.cc:260] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.310590 16354 heartbeater.cc:503] Master 127.4.61.254:34245 was elected leader, sending a full tablet report...
I20260808 18:39:09.310949 16399 ts_tablet_manager.cc:1428] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 18:39:09.311148 16398 raft_consensus.cc:348] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.311390 16398 raft_consensus.cc:374] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.311448 16398 raft_consensus.cc:729] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7204b1604647a29e83fdaf00541c80, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.311952 16398 consensus_queue.cc:260] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.312211 16402 tablet_bootstrap.cc:654] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.312974 16398 ts_tablet_manager.cc:1428] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260808 18:39:09.313283 16131 heartbeater.cc:503] Master 127.4.61.254:34245 was elected leader, sending a full tablet report...
I20260808 18:39:09.313548 16402 log.cc:824] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:09.315953 16402 tablet_bootstrap.cc:492] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: No bootstrap required, opened a new log
I20260808 18:39:09.316139 16402 ts_tablet_manager.cc:1397] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 18:39:09.319836 16402 raft_consensus.cc:348] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.320093 16402 raft_consensus.cc:374] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.320132 16402 raft_consensus.cc:729] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.320526 16402 consensus_queue.cc:260] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.321058 15927 heartbeater.cc:503] Master 127.4.61.254:34245 was elected leader, sending a full tablet report...
I20260808 18:39:09.321327 16402 ts_tablet_manager.cc:1428] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:39:09.344748 16409 raft_consensus.cc:482] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:09.344914 16409 raft_consensus.cc:504] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.345974 16409 leader_election.cc:288] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:09.349718 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.346431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:60099 (local address 127.4.61.194:44805)
0808 18:39:09.346550 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.346554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.346684 (+ 130us) server_negotiation.cc:407] Connection header received
0808 18:39:09.346790 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.346793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.346837 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.346897 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.347211 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.347713 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.348799 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.349192 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.349296 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.349350 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.349526 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.349596 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:39:09.349751 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.346291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:47239 (local address 127.4.61.195:38149)
0808 18:39:09.346444 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.346450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.346663 (+ 213us) server_negotiation.cc:407] Connection header received
0808 18:39:09.346785 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.346787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.346831 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.346900 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.347222 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.347734 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.348813 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.349198 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.349301 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.349353 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.349561 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.349631 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 18:39:09.349761 16412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.346288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:44805 (local address 127.4.61.193:60099)
0808 18:39:09.346590 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.346602 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.346705 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.346918 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.346921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.346965 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.347108 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.347113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.347816 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.347819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.348680 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.348689 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.349304 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.349307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.349403 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.349439 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.349501 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.349569 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":27,"spinlock_wait_cycles":18304,"thread_start_us":109,"threads_started":1}
I20260808 18:39:09.349772 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.346150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:38149 (local address 127.4.61.193:47239)
0808 18:39:09.346573 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.346587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.346688 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.346925 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.346927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.346968 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.347122 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.347128 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.347841 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.347844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.348701 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.348710 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.349310 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.349313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.349454 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.349472 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.349533 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.349599 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":102,"spinlock_wait_cycles":3200,"thread_start_us":164,"threads_started":1}
I20260808 18:39:09.350566 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51937f28abf34deb960b253ca4b3a3d2" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80" is_pre_election: true
I20260808 18:39:09.350628 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51937f28abf34deb960b253ca4b3a3d2" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46" is_pre_election: true
I20260808 18:39:09.350844 16059 raft_consensus.cc:2454] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:09.350884 16277 raft_consensus.cc:2454] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:09.351310 15762 leader_election.cc:302] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, bb7204b1604647a29e83fdaf00541c80; no voters:
I20260808 18:39:09.351549 16409 raft_consensus.cc:2781] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:09.351635 16409 raft_consensus.cc:482] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:09.351684 16409 raft_consensus.cc:3037] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.352696 16409 raft_consensus.cc:504] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.353019 16409 leader_election.cc:288] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Requested vote from peers fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:09.353325 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51937f28abf34deb960b253ca4b3a3d2" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46"
I20260808 18:39:09.353333 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51937f28abf34deb960b253ca4b3a3d2" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80"
I20260808 18:39:09.353434 16277 raft_consensus.cc:3037] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.353456 16059 raft_consensus.cc:3037] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.354457 16059 raft_consensus.cc:2454] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:09.354499 16277 raft_consensus.cc:2454] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:09.354739 15762 leader_election.cc:302] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, bb7204b1604647a29e83fdaf00541c80; no voters:
I20260808 18:39:09.354920 16409 raft_consensus.cc:2781] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:09.355124 16409 raft_consensus.cc:686] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Running, Role: LEADER
I20260808 18:39:09.355451 16409 consensus_queue.cc:237] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } }
I20260808 18:39:09.358644 15629 catalog_manager.cc:5495] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } health_report { overall_health: UNKNOWN } } }
I20260808 18:39:09.385424 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.382181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43642 (local address 127.4.61.193:38933)
0808 18:39:09.382331 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.382337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.382354 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:39:09.382431 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.382445 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.382522 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.382607 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:09.382818 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.383369 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.384157 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.384367 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.384446 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.384664 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.385103 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.385186 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.385259 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.385311 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:09.391319 16277 raft_consensus.cc:1261] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.391690 16059 raft_consensus.cc:1261] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.392011 16414 consensus_queue.cc:1035] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.392225 16409 consensus_queue.cc:1035] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.399788 16422 mvcc.cc:205] Tried to move back new op lower bound from 7316333975099789312 to 7316333974962630656. Current Snapshot: MvccSnapshot[applied={T|T < 7316333975099789312}]
I20260808 18:39:09.408332 15628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:09.408556 15628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:09.411158 15628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Sending DeleteTablet for 3 replicas of tablet 51937f28abf34deb960b253ca4b3a3d2
I20260808 18:39:09.412031 16248 tablet_service.cc:1514] Processing DeleteTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:59704
I20260808 18:39:09.412004 15825 tablet_service.cc:1514] Processing DeleteTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43630
I20260808 18:39:09.412093 16027 tablet_service.cc:1514] Processing DeleteTablet for tablet 51937f28abf34deb960b253ca4b3a3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260808 18:39:09.412582 16430 tablet_replica.cc:330] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: stopping tablet replica
I20260808 18:39:09.412576 16434 tablet_replica.cc:330] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: stopping tablet replica
I20260808 18:39:09.412907 16430 raft_consensus.cc:2229] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:09.412907 16434 raft_consensus.cc:2229] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:09.413239 16434 raft_consensus.cc:2258] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.413239 16430 raft_consensus.cc:2258] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.413664 16431 tablet_replica.cc:330] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: stopping tablet replica
I20260808 18:39:09.413748 15628 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 18:39:09.413966 16431 raft_consensus.cc:2229] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 LEADER]: Raft consensus shutting down.
W20260808 18:39:09.414186 15628 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:09.414443 16431 raft_consensus.cc:2258] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.415877 16430 ts_tablet_manager.cc:1905] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.416137 16431 ts_tablet_manager.cc:1905] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.418813 16430 ts_tablet_manager.cc:1918] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:09.418905 16431 ts_tablet_manager.cc:1918] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:09.419014 16431 log.cc:1196] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/51937f28abf34deb960b253ca4b3a3d2
I20260808 18:39:09.419023 16430 log.cc:1196] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/51937f28abf34deb960b253ca4b3a3d2
I20260808 18:39:09.419377 16431 ts_tablet_manager.cc:1939] T 51937f28abf34deb960b253ca4b3a3d2 P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting consensus metadata
I20260808 18:39:09.419503 16430 ts_tablet_manager.cc:1939] T 51937f28abf34deb960b253ca4b3a3d2 P fbb85a035e1e460c9370dd328caeda46: Deleting consensus metadata
I20260808 18:39:09.419762 15825 tablet_service.cc:1467] Processing CreateTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d (DEFAULT_TABLE table=test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.420020 15825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d3a09581e41a98a6e14c2d9620c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.420557 15606 catalog_manager.cc:4841] TS 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933): tablet 51937f28abf34deb960b253ca4b3a3d2 (table test-table [id=545e7039296440e2beb8ba21c00b0abe]) successfully deleted
I20260808 18:39:09.420975 15606 catalog_manager.cc:4841] TS fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149): tablet 51937f28abf34deb960b253ca4b3a3d2 (table test-table [id=545e7039296440e2beb8ba21c00b0abe]) successfully deleted
I20260808 18:39:09.421154 16248 tablet_service.cc:1467] Processing CreateTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d (DEFAULT_TABLE table=test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.421396 16248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d3a09581e41a98a6e14c2d9620c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.422124 16402 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Bootstrap starting.
I20260808 18:39:09.423127 16402 tablet_bootstrap.cc:654] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.423266 16399 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Bootstrap starting.
I20260808 18:39:09.424167 16399 tablet_bootstrap.cc:654] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.424350 16027 tablet_service.cc:1467] Processing CreateTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d (DEFAULT_TABLE table=test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.424626 16027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d3a09581e41a98a6e14c2d9620c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.425423 16399 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: No bootstrap required, opened a new log
I20260808 18:39:09.425493 16399 ts_tablet_manager.cc:1397] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:09.425549 16434 ts_tablet_manager.cc:1905] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.425916 16399 raft_consensus.cc:348] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.426024 16399 raft_consensus.cc:374] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.426055 16399 raft_consensus.cc:729] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.426173 16399 consensus_queue.cc:260] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.426927 16399 ts_tablet_manager.cc:1428] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:09.427006 16398 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Bootstrap starting.
I20260808 18:39:09.427785 16402 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: No bootstrap required, opened a new log
I20260808 18:39:09.427814 16398 tablet_bootstrap.cc:654] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.427878 16402 ts_tablet_manager.cc:1397] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 18:39:09.428324 16402 raft_consensus.cc:348] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.428457 16402 raft_consensus.cc:374] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.428495 16402 raft_consensus.cc:729] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.428619 16402 consensus_queue.cc:260] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.428861 16402 ts_tablet_manager.cc:1428] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:39:09.429208 16398 tablet_bootstrap.cc:492] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: No bootstrap required, opened a new log
I20260808 18:39:09.429286 16398 ts_tablet_manager.cc:1397] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 18:39:09.429750 16398 raft_consensus.cc:348] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.429860 16398 raft_consensus.cc:374] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.429894 16398 raft_consensus.cc:729] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7204b1604647a29e83fdaf00541c80, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.430006 16398 consensus_queue.cc:260] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.430249 16398 ts_tablet_manager.cc:1428] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:39:09.433470 16434 ts_tablet_manager.cc:1918] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:09.433557 16434 log.cc:1196] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/51937f28abf34deb960b253ca4b3a3d2
I20260808 18:39:09.433806 16434 ts_tablet_manager.cc:1939] T 51937f28abf34deb960b253ca4b3a3d2 P bb7204b1604647a29e83fdaf00541c80: Deleting consensus metadata
I20260808 18:39:09.434969 15609 catalog_manager.cc:4841] TS bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805): tablet 51937f28abf34deb960b253ca4b3a3d2 (table test-table [id=545e7039296440e2beb8ba21c00b0abe]) successfully deleted
W20260808 18:39:09.475814 16355 tablet.cc:2369] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:39:09.509053 16133 tablet.cc:2369] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:39:09.546204 15928 tablet.cc:2369] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:39:09.584393 16406 raft_consensus.cc:482] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:09.584537 16406 raft_consensus.cc:504] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.585662 16406 leader_election.cc:288] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:09.589246 16179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.585943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:44805 (local address 127.4.61.195:56145)
0808 18:39:09.586079 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.586095 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.586194 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.586528 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.586531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.586551 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.586665 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.586670 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.587397 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.587400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.588198 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.588208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.588844 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.588848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.588954 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.588972 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.589036 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.589107 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":1}
I20260808 18:39:09.589244 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.586049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:56145 (local address 127.4.61.194:44805)
0808 18:39:09.586176 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.586180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.586195 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:39:09.586333 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.586337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.586387 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.586460 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.586780 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.587287 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.588330 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.588733 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.588839 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.588893 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.589066 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.589137 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 18:39:09.589429 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.585944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.4.61.195:40379)
0808 18:39:09.586361 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.586375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.586476 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.586721 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.586724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.586738 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:09.586866 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.586871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.587578 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.587581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.588400 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.588409 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.589036 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.589040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.589130 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.589149 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.589212 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.589277 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":130,"thread_start_us":86,"threads_started":1}
I20260808 18:39:09.589425 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.586031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:40379 (local address 127.4.61.193:38933)
0808 18:39:09.586154 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.586159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.586462 (+ 303us) server_negotiation.cc:407] Connection header received
0808 18:39:09.586595 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.586598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.586639 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.586701 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:09.586972 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.587478 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.588525 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.588921 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.589020 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.589074 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.589242 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.589313 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:39:09.589828 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d3a09581e41a98a6e14c2d9620c8d" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80" is_pre_election: true
I20260808 18:39:09.589980 16059 raft_consensus.cc:2454] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 0.
I20260808 18:39:09.590030 15852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d3a09581e41a98a6e14c2d9620c8d" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" is_pre_election: true
I20260808 18:39:09.590299 15852 raft_consensus.cc:2454] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 0.
I20260808 18:39:09.590379 16170 leader_election.cc:302] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb7204b1604647a29e83fdaf00541c80, fbb85a035e1e460c9370dd328caeda46; no voters:
I20260808 18:39:09.590660 16406 raft_consensus.cc:2781] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:09.590723 16406 raft_consensus.cc:482] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:09.590766 16406 raft_consensus.cc:3037] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.591758 16406 raft_consensus.cc:504] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.592098 16406 leader_election.cc:288] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 election: Requested vote from peers 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:09.592375 15852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d3a09581e41a98a6e14c2d9620c8d" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf7b2b68a2f439689f183ad5a177ca7"
I20260808 18:39:09.592406 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d3a09581e41a98a6e14c2d9620c8d" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80"
I20260808 18:39:09.592478 15852 raft_consensus.cc:3037] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.592550 16059 raft_consensus.cc:3037] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.593469 15852 raft_consensus.cc:2454] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 1.
I20260808 18:39:09.593546 16059 raft_consensus.cc:2454] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 1.
I20260808 18:39:09.593755 16169 leader_election.cc:302] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, fbb85a035e1e460c9370dd328caeda46; no voters:
I20260808 18:39:09.593915 16406 raft_consensus.cc:2781] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:09.594105 16406 raft_consensus.cc:686] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 1 LEADER]: Becoming Leader. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Running, Role: LEADER
I20260808 18:39:09.594367 16406 consensus_queue.cc:237] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.596680 15627 catalog_manager.cc:5495] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb85a035e1e460c9370dd328caeda46 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "fbb85a035e1e460c9370dd328caeda46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } health_report { overall_health: HEALTHY } } }
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214348, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.254@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:09.647989 16456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.640205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34245 (local address 127.0.0.1:34612)
0808 18:39:09.640523 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.640540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.640695 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.641006 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.641009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.641536 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:09.641636 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.641644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.642420 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.642423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.642988 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.642996 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.643363 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.643365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.643422 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.643925 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:09.643936 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:09.645286 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:09.646656 (+ 1370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.646666 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.646672 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.646909 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.647107 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:09.647109 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:09.647110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:09.647181 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:09.647487 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:09.647493 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:09.647599 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.647688 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.647809 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":122,"threads_started":1}
I20260808 18:39:09.647997 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.640247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34612 (local address 127.4.61.254:34245)
0808 18:39:09.640509 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.640515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.640618 (+ 103us) server_negotiation.cc:407] Connection header received
0808 18:39:09.640795 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.640799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.640850 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.640931 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.641747 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.642294 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.643080 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.643282 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.643349 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.645409 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.645413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.645414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.645443 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.646566 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.646981 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.646983 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.646984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.647048 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.647241 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.647242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.647243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.647404 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.647488 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.647733 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.647865 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":157}
I20260808 18:39:09.651641 15627 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:34612:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 18:39:09.652359 15627 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:09.656926 15825 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c8db5dc264d57b5d79e62b99d6712 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb2964a65521484883d4f0013b01d526]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:39:09.657099 16248 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c8db5dc264d57b5d79e62b99d6712 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb2964a65521484883d4f0013b01d526]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:39:09.657158 16027 tablet_service.cc:1467] Processing CreateTablet for tablet 8e8c8db5dc264d57b5d79e62b99d6712 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb2964a65521484883d4f0013b01d526]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 18:39:09.657375 15825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c8db5dc264d57b5d79e62b99d6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.657446 16248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c8db5dc264d57b5d79e62b99d6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.657524 16027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e8c8db5dc264d57b5d79e62b99d6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:09.660043 16398 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: Bootstrap starting.
I20260808 18:39:09.660298 16399 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: Bootstrap starting.
I20260808 18:39:09.660881 16402 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: Bootstrap starting.
I20260808 18:39:09.661103 16398 tablet_bootstrap.cc:654] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.661216 16399 tablet_bootstrap.cc:654] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.661698 16402 tablet_bootstrap.cc:654] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:09.662628 16399 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: No bootstrap required, opened a new log
I20260808 18:39:09.662714 16399 ts_tablet_manager.cc:1397] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:09.662889 16402 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: No bootstrap required, opened a new log
I20260808 18:39:09.662969 16402 ts_tablet_manager.cc:1397] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:09.663064 16398 tablet_bootstrap.cc:492] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: No bootstrap required, opened a new log
I20260808 18:39:09.663156 16398 ts_tablet_manager.cc:1397] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:39:09.663189 16399 raft_consensus.cc:348] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663322 16399 raft_consensus.cc:374] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.663360 16399 raft_consensus.cc:729] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.663373 16402 raft_consensus.cc:348] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663508 16402 raft_consensus.cc:374] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.663493 16399 consensus_queue.cc:260] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663551 16402 raft_consensus.cc:729] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.663612 16398 raft_consensus.cc:348] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663673 16402 consensus_queue.cc:260] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663718 16398 raft_consensus.cc:374] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:09.663749 16398 raft_consensus.cc:729] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7204b1604647a29e83fdaf00541c80, State: Initialized, Role: FOLLOWER
I20260808 18:39:09.663795 16399 ts_tablet_manager.cc:1428] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:39:09.663873 16398 consensus_queue.cc:260] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.663925 16402 ts_tablet_manager.cc:1428] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:39:09.664125 16398 ts_tablet_manager.cc:1428] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:09.664101 16407 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.664228 16407 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.663743 16406 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.664305 16406 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.664309 16414 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.664440 16414 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.805464 16414 raft_consensus.cc:482] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:09.805608 16414 raft_consensus.cc:504] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.806041 16414 leader_election.cc:288] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805), fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149)
I20260808 18:39:09.806558 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c8db5dc264d57b5d79e62b99d6712" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80" is_pre_election: true
I20260808 18:39:09.806569 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c8db5dc264d57b5d79e62b99d6712" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46" is_pre_election: true
I20260808 18:39:09.806713 16059 raft_consensus.cc:2454] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:09.806728 16277 raft_consensus.cc:2454] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:09.807027 15761 leader_election.cc:302] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, fbb85a035e1e460c9370dd328caeda46; no voters:
I20260808 18:39:09.807241 16414 raft_consensus.cc:2781] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:09.807291 16414 raft_consensus.cc:482] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:09.807327 16414 raft_consensus.cc:3037] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.808338 16414 raft_consensus.cc:504] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.808660 16414 leader_election.cc:288] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Requested vote from peers bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805), fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149)
I20260808 18:39:09.809010 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c8db5dc264d57b5d79e62b99d6712" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46"
I20260808 18:39:09.809026 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e8c8db5dc264d57b5d79e62b99d6712" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80"
I20260808 18:39:09.809134 16059 raft_consensus.cc:3037] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.809135 16277 raft_consensus.cc:3037] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:09.809981 16059 raft_consensus.cc:2454] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:09.810181 16277 raft_consensus.cc:2454] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:09.810256 15762 leader_election.cc:302] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, bb7204b1604647a29e83fdaf00541c80; no voters:
I20260808 18:39:09.810570 16414 raft_consensus.cc:2781] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:09.810670 16414 raft_consensus.cc:686] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Running, Role: LEADER
I20260808 18:39:09.810807 16414 consensus_queue.cc:237] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:09.811475 16409 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: TxnStatusTablet state changed. Reason: New leader 7bf7b2b68a2f439689f183ad5a177ca7. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.811565 16409 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:39:09.811815 16461 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 18:39:09.811988 16461 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 18:39:09.812508 15629 catalog_manager.cc:5495] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } health_report { overall_health: UNKNOWN } } }
I20260808 18:39:09.857046 16456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.853512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.0.0.1:43646)
0808 18:39:09.853671 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.853687 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.853792 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.854045 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.854048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.854058 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:39:09.854168 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.854174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.854892 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.854895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.855870 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.855881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.856280 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.856284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.856362 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.856406 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.856711 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.856728 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.856811 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.856904 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 18:39:09.857046 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.853637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.4.61.193:38933)
0808 18:39:09.853753 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.853757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.853770 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:09.853902 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.853905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.853953 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.854014 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:09.854252 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.854795 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.855972 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.856172 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.856252 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.856539 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.856629 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.856694 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.856824 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.856900 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 18:39:09.859526 16059 raft_consensus.cc:1261] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.859549 16277 raft_consensus.cc:1261] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.860000 16414 consensus_queue.cc:1035] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.860157 16409 consensus_queue.cc:1035] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.861493 16406 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: TxnStatusTablet state changed. Reason: New leader 7bf7b2b68a2f439689f183ad5a177ca7. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.861605 16406 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.861824 16407 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: TxnStatusTablet state changed. Reason: New leader 7bf7b2b68a2f439689f183ad5a177ca7. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.861929 16407 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.863065 16414 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.863168 16414 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:39:09.864048 16418 mvcc.cc:205] Tried to move back new op lower bound from 7316333977020624896 to 7316333976826613760. Current Snapshot: MvccSnapshot[applied={T|T < 7316333977020624896 or (T in {7316333977020624896})}]
I20260808 18:39:09.864773 16409 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.864881 16409 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P 7bf7b2b68a2f439689f183ad5a177ca7: This TxnStatusTablet replica's current role is: LEADER
I20260808 18:39:09.865552 16407 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.865658 16407 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P bb7204b1604647a29e83fdaf00541c80: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.865948 16420 mvcc.cc:205] Tried to move back new op lower bound from 7316333977020624896 to 7316333976826613760. Current Snapshot: MvccSnapshot[applied={T|T < 7316333977020624896}]
I20260808 18:39:09.866109 16406 tablet_replica.cc:439] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } } }
I20260808 18:39:09.866209 16406 tablet_replica.cc:442] T 8e8c8db5dc264d57b5d79e62b99d6712 P fbb85a035e1e460c9370dd328caeda46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 18:39:09.873613 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.869763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59720 (local address 127.4.61.195:38149)
0808 18:39:09.869974 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.869977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.869989 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:09.870053 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.870055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.870102 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.870194 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:09.870512 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.871035 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.872170 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.872399 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.872488 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.872743 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.873215 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.873299 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.873388 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.873451 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":74,"threads_started":1}
I20260808 18:39:09.884215 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.880666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:52521 (local address 127.4.61.193:38933)
0808 18:39:09.880792 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.880797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.880939 (+ 142us) server_negotiation.cc:407] Connection header received
0808 18:39:09.881060 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.881062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.881106 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.881164 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:09.881400 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.881944 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.883193 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.883412 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.883518 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.883814 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.883888 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.883940 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.884043 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.884096 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:39:09.884277 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.880537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.4.61.195:52521)
0808 18:39:09.880864 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.880879 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.880978 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.881188 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.881191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.881198 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:39:09.881312 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.881318 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.882043 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.882046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.883075 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.883087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.883525 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.883529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.883633 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.883690 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.883963 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.883969 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.884026 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.884108 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":114,"threads_started":1}
I20260808 18:39:09.891448 16059 raft_consensus.cc:1261] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Refusing update from remote peer fbb85a035e1e460c9370dd328caeda46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.891736 15852 raft_consensus.cc:1261] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Refusing update from remote peer fbb85a035e1e460c9370dd328caeda46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:09.891978 16406 consensus_queue.cc:1035] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.892179 16445 consensus_queue.cc:1035] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:09.915033 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.911432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:59259 (local address 127.4.61.195:38149)
0808 18:39:09.911553 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.911558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.911778 (+ 220us) server_negotiation.cc:407] Connection header received
0808 18:39:09.911923 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.911926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.911978 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.912036 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:09.912286 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.912930 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.914008 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.914234 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.914342 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.914623 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.914698 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.914755 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.914847 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.914897 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 18:39:09.915063 16481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.911401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:38149 (local address 127.4.61.193:59259)
0808 18:39:09.911698 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:09.911711 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:09.911829 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:09.912053 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:09.912056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:09.912064 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:39:09.912167 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.912173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.913069 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.913073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.913891 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:09.913902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.914351 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.914354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:09.914457 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.914501 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:39:09.914773 (+ 272us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:39:09.914780 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:39:09.914837 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 18:39:09.914914 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":104,"threads_started":1}
I20260808 18:39:09.939538 15624 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:09.939731 15624 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:09.943406 15624 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Sending DeleteTablet for 3 replicas of tablet df6d3a09581e41a98a6e14c2d9620c8d
I20260808 18:39:09.944029 15825 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43630
I20260808 18:39:09.944118 16027 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260808 18:39:09.944432 16248 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d3a09581e41a98a6e14c2d9620c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:09 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:59704
I20260808 18:39:09.944681 16486 tablet_replica.cc:330] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: stopping tablet replica
I20260808 18:39:09.944796 16486 raft_consensus.cc:2229] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:09.944906 16486 raft_consensus.cc:2258] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.945128 16485 tablet_replica.cc:330] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: stopping tablet replica
I20260808 18:39:09.945243 16485 raft_consensus.cc:2229] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:09.945346 16485 raft_consensus.cc:2258] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.946039 16485 ts_tablet_manager.cc:1905] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.946895 16486 ts_tablet_manager.cc:1905] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.949971 16486 ts_tablet_manager.cc:1918] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:39:09.950058 16486 log.cc:1196] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/df6d3a09581e41a98a6e14c2d9620c8d
I20260808 18:39:09.950302 16486 ts_tablet_manager.cc:1939] T df6d3a09581e41a98a6e14c2d9620c8d P bb7204b1604647a29e83fdaf00541c80: Deleting consensus metadata
I20260808 18:39:09.951081 16488 tablet_replica.cc:330] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: stopping tablet replica
I20260808 18:39:09.951072 15609 catalog_manager.cc:4841] TS bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805): tablet df6d3a09581e41a98a6e14c2d9620c8d (table test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]) successfully deleted
I20260808 18:39:09.951295 16488 raft_consensus.cc:2229] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:09.951687 16488 raft_consensus.cc:2258] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:09.952412 16488 ts_tablet_manager.cc:1905] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:09.953856 16485 ts_tablet_manager.cc:1918] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:39:09.953969 16485 log.cc:1196] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/df6d3a09581e41a98a6e14c2d9620c8d
I20260808 18:39:09.954224 16485 ts_tablet_manager.cc:1939] T df6d3a09581e41a98a6e14c2d9620c8d P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting consensus metadata
I20260808 18:39:09.954977 15606 catalog_manager.cc:4841] TS 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933): tablet df6d3a09581e41a98a6e14c2d9620c8d (table test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]) successfully deleted
I20260808 18:39:09.955456 16488 ts_tablet_manager.cc:1918] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:39:09.955524 16488 log.cc:1196] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/df6d3a09581e41a98a6e14c2d9620c8d
I20260808 18:39:09.955734 16488 ts_tablet_manager.cc:1939] T df6d3a09581e41a98a6e14c2d9620c8d P fbb85a035e1e460c9370dd328caeda46: Deleting consensus metadata
I20260808 18:39:09.956329 15606 catalog_manager.cc:4841] TS fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149): tablet df6d3a09581e41a98a6e14c2d9620c8d (table test-table [id=f2d4fe1edeb84d1ba9f5b87e786868a7]) successfully deleted
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 18:39:09.982152 15702 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:09.975866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34620 (local address 127.4.61.254:34245)
0808 18:39:09.976009 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.976014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.976124 (+ 110us) server_negotiation.cc:407] Connection header received
0808 18:39:09.976242 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.976245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.976300 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.976394 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.977144 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.977980 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.978913 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.979261 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.979366 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.982027 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34620: BlockingRecv error: recv got EOF from 127.0.0.1:34620 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 18:39:09 dist-test-slave-fgb3 krb5kdc[15561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM
I20260808 18:39:09.991122 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:09.983509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34636 (local address 127.4.61.254:34245)
0808 18:39:09.983611 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:09.983615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:09.983754 (+ 139us) server_negotiation.cc:407] Connection header received
0808 18:39:09.983858 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:09.983861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:09.983901 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:09.983976 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:09.984509 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.984994 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.985734 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:09.985957 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:09.986040 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:09.988321 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:09.988324 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:09.988332 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:09.988355 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:09.989571 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.990008 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.990011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.990012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.990077 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:09.990334 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:09.990337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:09.990338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:09.990550 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:09.990677 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:09.990896 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 18:39:09.990995 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 18:39:09.993594 15624 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:39:09.994022 15624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:09.998869 15825 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec (DEFAULT_TABLE table=test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:09.999217 15825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdc5797f2ce44019dd5abb0021873ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.001392 16402 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Bootstrap starting.
I20260808 18:39:10.001612 16248 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec (DEFAULT_TABLE table=test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:10.001894 16248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdc5797f2ce44019dd5abb0021873ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.002262 16402 tablet_bootstrap.cc:654] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.003700 16402 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: No bootstrap required, opened a new log
I20260808 18:39:10.003791 16402 ts_tablet_manager.cc:1397] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:10.004236 16402 raft_consensus.cc:348] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.004366 16402 raft_consensus.cc:374] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.004407 16402 raft_consensus.cc:729] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.004456 16399 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Bootstrap starting.
I20260808 18:39:10.004537 16402 consensus_queue.cc:260] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.004814 16402 ts_tablet_manager.cc:1428] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:10.005328 16399 tablet_bootstrap.cc:654] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.006495 16027 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec (DEFAULT_TABLE table=test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:10.006861 16027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdc5797f2ce44019dd5abb0021873ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.009142 16399 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: No bootstrap required, opened a new log
I20260808 18:39:10.009222 16399 ts_tablet_manager.cc:1397] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 18:39:10.009385 16398 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Bootstrap starting.
I20260808 18:39:10.009666 16399 raft_consensus.cc:348] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.009778 16399 raft_consensus.cc:374] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.009809 16399 raft_consensus.cc:729] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.009928 16399 consensus_queue.cc:260] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.010200 16399 ts_tablet_manager.cc:1428] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 18:39:10.010285 16398 tablet_bootstrap.cc:654] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.012650 16398 tablet_bootstrap.cc:492] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: No bootstrap required, opened a new log
I20260808 18:39:10.012733 16398 ts_tablet_manager.cc:1397] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 18:39:10.013123 16398 raft_consensus.cc:348] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.013217 16398 raft_consensus.cc:374] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.013247 16398 raft_consensus.cc:729] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7204b1604647a29e83fdaf00541c80, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.013365 16398 consensus_queue.cc:260] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.013607 16398 ts_tablet_manager.cc:1428] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:39:10.191900 16406 raft_consensus.cc:482] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:10.192044 16406 raft_consensus.cc:504] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.192454 16406 leader_election.cc:288] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:10.192857 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdc5797f2ce44019dd5abb0021873ec" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80" is_pre_election: true
I20260808 18:39:10.192857 15852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdc5797f2ce44019dd5abb0021873ec" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" is_pre_election: true
I20260808 18:39:10.193028 16059 raft_consensus.cc:2454] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 0.
I20260808 18:39:10.193032 15852 raft_consensus.cc:2454] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 0.
I20260808 18:39:10.193332 16170 leader_election.cc:302] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb7204b1604647a29e83fdaf00541c80, fbb85a035e1e460c9370dd328caeda46; no voters:
I20260808 18:39:10.193547 16406 raft_consensus.cc:2781] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:10.193609 16406 raft_consensus.cc:482] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:10.193640 16406 raft_consensus.cc:3037] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.194707 16406 raft_consensus.cc:504] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.195027 16406 leader_election.cc:288] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 election: Requested vote from peers 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933), bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805)
I20260808 18:39:10.195417 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdc5797f2ce44019dd5abb0021873ec" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80"
I20260808 18:39:10.195408 15852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdc5797f2ce44019dd5abb0021873ec" candidate_uuid: "fbb85a035e1e460c9370dd328caeda46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf7b2b68a2f439689f183ad5a177ca7"
I20260808 18:39:10.195533 16059 raft_consensus.cc:3037] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.195539 15852 raft_consensus.cc:3037] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.196462 15852 raft_consensus.cc:2454] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 1.
I20260808 18:39:10.196488 16059 raft_consensus.cc:2454] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb85a035e1e460c9370dd328caeda46 in term 1.
I20260808 18:39:10.196734 16169 leader_election.cc:302] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, fbb85a035e1e460c9370dd328caeda46; no voters:
I20260808 18:39:10.196907 16406 raft_consensus.cc:2781] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:10.197002 16406 raft_consensus.cc:686] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 1 LEADER]: Becoming Leader. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Running, Role: LEADER
I20260808 18:39:10.197142 16406 consensus_queue.cc:237] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.198849 15624 catalog_manager.cc:5495] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb85a035e1e460c9370dd328caeda46 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "fbb85a035e1e460c9370dd328caeda46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } health_report { overall_health: HEALTHY } } }
I20260808 18:39:10.243815 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:10.239765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.4.61.195:38149)
0808 18:39:10.239906 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:10.239911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:10.239927 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:39:10.240026 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:10.240029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:10.240082 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:10.240153 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:10.240371 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.241148 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.242366 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.242739 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.242834 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:10.243179 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:10.243275 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:10.243339 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:10.243654 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 18:39:10.243706 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:39:10.245714 16059 raft_consensus.cc:1261] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Refusing update from remote peer fbb85a035e1e460c9370dd328caeda46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:10.245872 15852 raft_consensus.cc:1261] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Refusing update from remote peer fbb85a035e1e460c9370dd328caeda46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:10.246263 16406 consensus_queue.cc:1035] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:10.246460 16477 consensus_queue.cc:1035] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:10.253166 15624 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:10.253296 15624 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:10.255033 15624 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Sending DeleteTablet for 3 replicas of tablet 6bdc5797f2ce44019dd5abb0021873ec
I20260808 18:39:10.255503 15825 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43630
I20260808 18:39:10.255548 16027 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260808 18:39:10.255635 16248 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdc5797f2ce44019dd5abb0021873ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:59704
I20260808 18:39:10.255683 16485 tablet_replica.cc:330] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: stopping tablet replica
I20260808 18:39:10.255688 16486 tablet_replica.cc:330] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: stopping tablet replica
I20260808 18:39:10.255788 16485 raft_consensus.cc:2229] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:10.255788 16486 raft_consensus.cc:2229] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:10.255908 16486 raft_consensus.cc:2258] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:10.255908 16485 raft_consensus.cc:2258] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:10.256011 16488 tablet_replica.cc:330] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: stopping tablet replica
I20260808 18:39:10.256126 16488 raft_consensus.cc:2229] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:10.256189 15624 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 18:39:10.256292 16488 raft_consensus.cc:2258] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 18:39:10.256565 15624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:10.256604 16486 ts_tablet_manager.cc:1905] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:10.256605 16485 ts_tablet_manager.cc:1905] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:10.257289 16488 ts_tablet_manager.cc:1905] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:10.259094 16486 ts_tablet_manager.cc:1918] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:10.259094 16485 ts_tablet_manager.cc:1918] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:10.259167 16485 log.cc:1196] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/6bdc5797f2ce44019dd5abb0021873ec
I20260808 18:39:10.259167 16486 log.cc:1196] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/6bdc5797f2ce44019dd5abb0021873ec
I20260808 18:39:10.259407 16486 ts_tablet_manager.cc:1939] T 6bdc5797f2ce44019dd5abb0021873ec P bb7204b1604647a29e83fdaf00541c80: Deleting consensus metadata
I20260808 18:39:10.259407 16485 ts_tablet_manager.cc:1939] T 6bdc5797f2ce44019dd5abb0021873ec P 7bf7b2b68a2f439689f183ad5a177ca7: Deleting consensus metadata
I20260808 18:39:10.259852 16488 ts_tablet_manager.cc:1918] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:10.259922 16488 log.cc:1196] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/6bdc5797f2ce44019dd5abb0021873ec
I20260808 18:39:10.260047 15606 catalog_manager.cc:4841] TS 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933): tablet 6bdc5797f2ce44019dd5abb0021873ec (table test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]) successfully deleted
I20260808 18:39:10.260151 16488 ts_tablet_manager.cc:1939] T 6bdc5797f2ce44019dd5abb0021873ec P fbb85a035e1e460c9370dd328caeda46: Deleting consensus metadata
I20260808 18:39:10.261149 15606 catalog_manager.cc:4841] TS fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149): tablet 6bdc5797f2ce44019dd5abb0021873ec (table test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]) successfully deleted
I20260808 18:39:10.261269 16027 tablet_service.cc:1467] Processing CreateTablet for tablet e06c361753cc475689ff673f0924c613 (DEFAULT_TABLE table=test-table [id=4554f9ea9668479b825ac40cb76df016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:10.261492 16027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e06c361753cc475689ff673f0924c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.261502 16248 tablet_service.cc:1467] Processing CreateTablet for tablet e06c361753cc475689ff673f0924c613 (DEFAULT_TABLE table=test-table [id=4554f9ea9668479b825ac40cb76df016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:10.261739 16248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e06c361753cc475689ff673f0924c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.261782 15825 tablet_service.cc:1467] Processing CreateTablet for tablet e06c361753cc475689ff673f0924c613 (DEFAULT_TABLE table=test-table [id=4554f9ea9668479b825ac40cb76df016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:10.261998 15825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e06c361753cc475689ff673f0924c613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:10.263195 16398 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Bootstrap starting.
I20260808 18:39:10.263790 16399 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Bootstrap starting.
I20260808 18:39:10.263917 16398 tablet_bootstrap.cc:654] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.264420 16402 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: Bootstrap starting.
I20260808 18:39:10.264580 16399 tablet_bootstrap.cc:654] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.265154 16402 tablet_bootstrap.cc:654] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:10.265702 15609 catalog_manager.cc:4841] TS bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805): tablet 6bdc5797f2ce44019dd5abb0021873ec (table test-table [id=aef7a7ec26cf40ffa6291e36b97f38f8]) successfully deleted
I20260808 18:39:10.265745 16399 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: No bootstrap required, opened a new log
I20260808 18:39:10.265784 16398 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: No bootstrap required, opened a new log
I20260808 18:39:10.265825 16399 ts_tablet_manager.cc:1397] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 18:39:10.265872 16398 ts_tablet_manager.cc:1397] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 18:39:10.266142 16399 raft_consensus.cc:348] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.266222 16399 raft_consensus.cc:374] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.266242 16399 raft_consensus.cc:729] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb85a035e1e460c9370dd328caeda46, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.266287 16402 tablet_bootstrap.cc:492] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: No bootstrap required, opened a new log
I20260808 18:39:10.266404 16402 ts_tablet_manager.cc:1397] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:10.266369 16399 consensus_queue.cc:260] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.266302 16398 raft_consensus.cc:348] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.266577 16398 raft_consensus.cc:374] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.266616 16398 raft_consensus.cc:729] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7204b1604647a29e83fdaf00541c80, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.266623 16399 ts_tablet_manager.cc:1428] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 18:39:10.266763 16398 consensus_queue.cc:260] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.266788 16402 raft_consensus.cc:348] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.266875 16402 raft_consensus.cc:374] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:10.266911 16402 raft_consensus.cc:729] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Initialized, Role: FOLLOWER
I20260808 18:39:10.267035 16398 ts_tablet_manager.cc:1428] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 18:39:10.267027 16402 consensus_queue.cc:260] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.267274 16402 ts_tablet_manager.cc:1428] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 18:39:10.495469 16409 raft_consensus.cc:482] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:10.495635 16409 raft_consensus.cc:504] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.496042 16409 leader_election.cc:288] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805), fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149)
I20260808 18:39:10.496402 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e06c361753cc475689ff673f0924c613" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46" is_pre_election: true
I20260808 18:39:10.496469 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e06c361753cc475689ff673f0924c613" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80" is_pre_election: true
I20260808 18:39:10.496558 16277 raft_consensus.cc:2454] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:10.496618 16059 raft_consensus.cc:2454] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 0.
I20260808 18:39:10.496964 15762 leader_election.cc:302] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, bb7204b1604647a29e83fdaf00541c80; no voters:
I20260808 18:39:10.497155 16409 raft_consensus.cc:2781] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:10.497269 16409 raft_consensus.cc:482] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:10.497320 16409 raft_consensus.cc:3037] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.498556 16409 raft_consensus.cc:504] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.498906 16409 leader_election.cc:288] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Requested vote from peers bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805), fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149)
I20260808 18:39:10.499301 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e06c361753cc475689ff673f0924c613" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7204b1604647a29e83fdaf00541c80"
I20260808 18:39:10.499428 16059 raft_consensus.cc:3037] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.500427 16059 raft_consensus.cc:2454] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:10.500671 16277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e06c361753cc475689ff673f0924c613" candidate_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb85a035e1e460c9370dd328caeda46"
I20260808 18:39:10.500701 15762 leader_election.cc:302] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bf7b2b68a2f439689f183ad5a177ca7, bb7204b1604647a29e83fdaf00541c80; no voters:
I20260808 18:39:10.500792 16277 raft_consensus.cc:3037] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:10.500883 16409 raft_consensus.cc:2781] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:10.501049 16409 raft_consensus.cc:686] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf7b2b68a2f439689f183ad5a177ca7, State: Running, Role: LEADER
I20260808 18:39:10.501201 16409 consensus_queue.cc:237] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } }
I20260808 18:39:10.501966 16277 raft_consensus.cc:2454] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf7b2b68a2f439689f183ad5a177ca7 in term 1.
I20260808 18:39:10.502986 15628 catalog_manager.cc:5495] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf7b2b68a2f439689f183ad5a177ca7" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 38933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 } health_report { overall_health: UNKNOWN } } }
I20260808 18:39:10.569370 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:10.566341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43648 (local address 127.4.61.193:38933)
0808 18:39:10.566585 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:10.566589 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:10.566601 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:10.566640 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:10.566642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:10.566683 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:10.566752 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:10.566998 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.567529 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.568339 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.568571 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.568661 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:10.568915 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:10.569005 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:10.569064 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:10.569161 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 18:39:10.569218 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":67,"threads_started":1}
I20260808 18:39:10.577674 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:10.574839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:48129 (local address 127.4.61.193:38933)
0808 18:39:10.574949 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:10.574953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:10.575079 (+ 126us) server_negotiation.cc:407] Connection header received
0808 18:39:10.575165 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:10.575167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:10.575208 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:10.575274 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:10.575447 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.575937 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.576724 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.576950 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.577031 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:10.577295 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:10.577365 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:10.577429 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:10.577503 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 18:39:10.577548 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:39:10.577687 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:10.574761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.4.61.193:48129)
0808 18:39:10.575004 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:10.575016 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:10.575101 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:10.575284 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:10.575286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:10.575292 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 18:39:10.575377 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:10.575381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.576009 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.576011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:10.576608 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:10.576616 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:10.577058 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:10.577060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:10.577128 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:10.577154 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 18:39:10.577442 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 18:39:10.577446 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 18:39:10.577485 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 18:39:10.577556 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260808 18:39:10.583120 16277 raft_consensus.cc:1261] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:10.583122 16059 raft_consensus.cc:1261] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Refusing update from remote peer 7bf7b2b68a2f439689f183ad5a177ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:10.583482 16530 consensus_queue.cc:1035] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7204b1604647a29e83fdaf00541c80" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:10.583642 16532 consensus_queue.cc:1035] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb85a035e1e460c9370dd328caeda46" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 38149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:10.614140 15628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:10.614305 15628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:10.616186 15628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f956064369bd4d8a812f343259f4ac4d: Sending DeleteTablet for 3 replicas of tablet e06c361753cc475689ff673f0924c613
I20260808 18:39:10.616766 16027 tablet_service.cc:1514] Processing DeleteTablet for tablet e06c361753cc475689ff673f0924c613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260808 18:39:10.616762 16248 tablet_service.cc:1514] Processing DeleteTablet for tablet e06c361753cc475689ff673f0924c613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:59704
I20260808 18:39:10.616956 16486 tablet_replica.cc:330] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: stopping tablet replica
I20260808 18:39:10.616954 16488 tablet_replica.cc:330] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: stopping tablet replica
I20260808 18:39:10.617077 16486 raft_consensus.cc:2229] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:10.617080 16488 raft_consensus.cc:2229] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:10.617108 15825 tablet_service.cc:1514] Processing DeleteTablet for tablet e06c361753cc475689ff673f0924c613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:10 UTC) from {username='oryx', principal='oryx/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43630
I20260808 18:39:10.617187 16486 raft_consensus.cc:2258] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:10.617197 16488 raft_consensus.cc:2258] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:10.617285 16485 tablet_replica.cc:330] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7: stopping tablet replica
I20260808 18:39:10.617419 16485 raft_consensus.cc:2229] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:10.617609 16485 raft_consensus.cc:2258] T e06c361753cc475689ff673f0924c613 P 7bf7b2b68a2f439689f183ad5a177ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:10.617668 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 15733
I20260808 18:39:10.617904 16486 ts_tablet_manager.cc:1905] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:10.620826 16486 ts_tablet_manager.cc:1918] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:39:10.620913 16486 log.cc:1196] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/e06c361753cc475689ff673f0924c613
I20260808 18:39:10.621158 16486 ts_tablet_manager.cc:1939] T e06c361753cc475689ff673f0924c613 P bb7204b1604647a29e83fdaf00541c80: Deleting consensus metadata
I20260808 18:39:10.621829 15609 catalog_manager.cc:4841] TS bb7204b1604647a29e83fdaf00541c80 (127.4.61.194:44805): tablet e06c361753cc475689ff673f0924c613 (table test-table [id=4554f9ea9668479b825ac40cb76df016]) successfully deleted
I20260808 18:39:10.627069 16488 ts_tablet_manager.cc:1905] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:10.629340 16488 ts_tablet_manager.cc:1918] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 18:39:10.629415 16488 log.cc:1196] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/e06c361753cc475689ff673f0924c613
I20260808 18:39:10.629630 16488 ts_tablet_manager.cc:1939] T e06c361753cc475689ff673f0924c613 P fbb85a035e1e460c9370dd328caeda46: Deleting consensus metadata
I20260808 18:39:10.630342 15606 catalog_manager.cc:4841] TS fbb85a035e1e460c9370dd328caeda46 (127.4.61.195:38149): tablet e06c361753cc475689ff673f0924c613 (table test-table [id=4554f9ea9668479b825ac40cb76df016]) successfully deleted
W20260808 18:39:10.634961 15606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:38933 (error 108)
I20260808 18:39:10.635242 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 15938
I20260808 18:39:10.644093 16551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:10.639625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:38933 (local address 127.0.0.1:43650)
0808 18:39:10.643803 (+ 4178us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:10.643901 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:38933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4076,"thread_start_us":2201,"threads_started":1}
W20260808 18:39:10.644258 15606 catalog_manager.cc:4584] TS 7bf7b2b68a2f439689f183ad5a177ca7 (127.4.61.193:38933): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e06c361753cc475689ff673f0924c613: Network error: Client connection negotiation failed: client connection to 127.4.61.193:38933: connect: Connection refused (error 111)
I20260808 18:39:10.652218 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 16142
I20260808 18:39:10.668217 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 15578
2026-08-08T18:39:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3592 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:10 dist-test-slave-fgb3 krb5kdc[16558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:10 dist-test-slave-fgb3 krb5kdc[16558](info): set up 2 sockets
Aug 08 18:39:10 dist-test-slave-fgb3 krb5kdc[16558](info): commencing operation
krb5kdc: starting...
W20260808 18:39:12.418408 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.719s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:12 dist-test-slave-fgb3 krb5kdc[16558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:39:12.575497 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40707
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:12.688494 16573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:12.688817 16573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:12.688880 16573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:12.692914 16573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:12.692982 16573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:12.693008 16573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:12.693029 16573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:12.693050 16573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:12.698465 16573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:12.699566 16573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:12.700606 16573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:12.709347 16582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:12.709352 16583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:12.709364 16587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:12.709416 16573 server_base.cc:1034] running on GCE node
I20260808 18:39:12.710270 16573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:12.711429 16573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:12.712615 16573 hybrid_clock.cc:648] HybridClock initialized: now 1786214352712586 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T18:39:12Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2046 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:12 dist-test-slave-fgb3 krb5kdc[16593](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:12 dist-test-slave-fgb3 krb5kdc[16593](info): set up 2 sockets
Aug 08 18:39:12 dist-test-slave-fgb3 krb5kdc[16593](info): commencing operation
krb5kdc: starting...
W20260808 18:39:13.865568 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:13 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:39:13.989365 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44383
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:14.100678 16610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:14.100934 16610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:14.100975 16610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:14.104888 16610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:14.104945 16610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:14.104964 16610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:14.104979 16610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:14.104992 16610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:14.110064 16610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:14.111063 16610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:14.112002 16610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:14.120265 16622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:14.120465 16610 server_base.cc:1034] running on GCE node
W20260808 18:39:14.121953 16620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.122560 16619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:14.123147 16610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:14.124198 16610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:14.125349 16610 hybrid_clock.cc:648] HybridClock initialized: now 1786214354125324 us; error 37 us; skew 500 ppm
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:14.131752 16610 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:39:14.132680 16610 webserver.cc:460] Webserver started at http://127.4.61.254:33895/ using document root <none> and password file <none>
I20260808 18:39:14.133221 16610 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:14.133283 16610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:14.133499 16610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:14.135636 16610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "d3aa0b621e354d5b9653b5e7131cafb3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "a7606e7163da52c00f907937139b91b1"
server_key_iv: "5a5b7e2044549b8a915705e708553053"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.136204 16610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "d3aa0b621e354d5b9653b5e7131cafb3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "a7606e7163da52c00f907937139b91b1"
server_key_iv: "5a5b7e2044549b8a915705e708553053"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.140051 16610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 18:39:14.142544 16635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.143759 16610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:39:14.143863 16610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "d3aa0b621e354d5b9653b5e7131cafb3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "a7606e7163da52c00f907937139b91b1"
server_key_iv: "5a5b7e2044549b8a915705e708553053"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.143975 16610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:14.156210 16610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:14.159070 16610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:14.159248 16610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:14.166143 16610 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:44383
I20260808 18:39:14.166164 16717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:44383 every 8 connection(s)
I20260808 18:39:14.167126 16610 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:14.170017 16718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:14.175668 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 16610
I20260808 18:39:14.175797 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:14.175782 16718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Bootstrap starting.
I20260808 18:39:14.176065 4343 external_mini_cluster.cc:1428] Setting key 8d4a445b49f078ea25ba531d39b1bb9b
I20260808 18:39:14.178412 16718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:14.179178 16718 log.cc:824] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:14.181154 16718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: No bootstrap required, opened a new log
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:14.185611 16718 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:14.185882 16718 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:14.185945 16718 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3aa0b621e354d5b9653b5e7131cafb3, State: Initialized, Role: FOLLOWER
I20260808 18:39:14.186508 16718 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:14.186687 16718 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:14.186759 16718 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:14.186867 16718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:14.188071 16718 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:14.188462 16718 leader_election.cc:302] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3aa0b621e354d5b9653b5e7131cafb3; no voters:
I20260808 18:39:14.188839 16718 leader_election.cc:288] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:14.188928 16727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:14.189177 16727 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 LEADER]: Becoming Leader. State: Replica: d3aa0b621e354d5b9653b5e7131cafb3, State: Running, Role: LEADER
I20260808 18:39:14.189589 16727 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:14.190349 16718 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:14.191412 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.177473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53608 (local address 127.4.61.254:44383)
0808 18:39:14.177889 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:14.177905 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:14.177950 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:39:14.178685 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:14.178708 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:14.179072 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:14.179401 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:14.180237 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.181249 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.182493 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.182992 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.183112 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.185875 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:14.185882 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:14.185899 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:14.185937 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:14.187954 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.188405 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.188416 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.188422 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.188575 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.188955 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.188959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.188960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.189520 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:14.189715 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:14.190039 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 18:39:14.190390 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":122,"threads_started":1}
I20260808 18:39:14.191372 16729 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } } }
I20260808 18:39:14.191607 16728 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3aa0b621e354d5b9653b5e7131cafb3. Latest consensus state: current_term: 1 leader_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } } }
I20260808 18:39:14.192461 16729 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:14.192777 16728 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: This master's current role is: LEADER
W20260808 18:39:14.195621 16745 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:39:14.195686 16745 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:39:14.195755 16748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:14.196460 16748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:14.201973 16748 catalog_manager.cc:1347] Generated new cluster ID: f1c0ae400a594a31b6bc393c6316435c
I20260808 18:39:14.202039 16748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:14.217835 16748 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:14.219260 16748 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:14.225236 16748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Generated new TSK 0
I20260808 18:39:14.226092 16748 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:39:14.259516 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:14.373606 16753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:14.373868 16753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:14.373908 16753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:14.377941 16753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:14.378021 16753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:14.378079 16753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:14.383401 16753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:14.384512 16753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:14.385567 16753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:14.395141 16765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.395146 16767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.395197 16763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:14.395641 16753 server_base.cc:1034] running on GCE node
I20260808 18:39:14.396025 16753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:14.396632 16753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:14.397796 16753 hybrid_clock.cc:648] HybridClock initialized: now 1786214354397780 us; error 31 us; skew 500 ppm
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:14.400583 16753 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:39:14.401481 16753 webserver.cc:460] Webserver started at http://127.4.61.193:46667/ using document root <none> and password file <none>
I20260808 18:39:14.402021 16753 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:14.402086 16753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:14.402274 16753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:14.404320 16753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "5f0d7a6f8d9e412fb3aff09996767412"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "b9dba888372a685981c09a0e80d45f06"
server_key_iv: "ecd1280fb78d52b3c762cec9f50937ad"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.404877 16753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "5f0d7a6f8d9e412fb3aff09996767412"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "b9dba888372a685981c09a0e80d45f06"
server_key_iv: "ecd1280fb78d52b3c762cec9f50937ad"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.408565 16753 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 18:39:14.410959 16776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.412168 16753 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:39:14.412269 16753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "5f0d7a6f8d9e412fb3aff09996767412"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "b9dba888372a685981c09a0e80d45f06"
server_key_iv: "ecd1280fb78d52b3c762cec9f50937ad"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.412375 16753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:14.423573 16753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:14.426090 16753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:14.426256 16753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:14.426841 16753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:14.427635 16753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:14.427683 16753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.427726 16753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:14.427753 16753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.436545 16753 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:40887
I20260808 18:39:14.436600 16954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:40887 every 8 connection(s)
I20260808 18:39:14.437441 16753 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:14.446734 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 16753
I20260808 18:39:14.446868 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:14.447185 4343 external_mini_cluster.cc:1428] Setting key 93f182a21d004273abeab024aafe752c
I20260808 18:39:14.451238 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.439395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:52057 (local address 127.4.61.254:44383)
0808 18:39:14.439571 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:14.439576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:14.440620 (+ 1044us) server_negotiation.cc:407] Connection header received
0808 18:39:14.441594 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:14.441598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:14.441650 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:14.441726 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:14.443011 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.443545 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.444698 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.444914 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.444978 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.447609 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:14.447612 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:14.447614 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:14.447638 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:14.449156 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.449680 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.449684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.449685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.449779 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.450098 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.450100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.450102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.450345 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:14.450450 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:14.450935 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 18:39:14.451068 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 18:39:14.452057 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.439752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:52057)
0808 18:39:14.440465 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:14.440510 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:14.441360 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:14.441893 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:14.441900 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:14.442307 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:14.442877 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.442893 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.443660 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.443663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.444602 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.444613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.445025 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.445028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.445170 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.445806 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:14.445824 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:14.447433 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:14.449301 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.449305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.449318 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.449572 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.449872 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.449874 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.449876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.450016 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.450437 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:14.450442 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:14.450683 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 18:39:14.450871 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 18:39:14.451201 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":108,"threads_started":1}
I20260808 18:39:14.453385 16956 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44383
I20260808 18:39:14.453646 16956 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:14.454226 16956 heartbeater.cc:511] Master 127.4.61.254:44383 requested a full tablet report, sending...
I20260808 18:39:14.456115 16659 ts_manager.cc:194] Registered new tserver with Master: 5f0d7a6f8d9e412fb3aff09996767412 (127.4.61.193:40887)
I20260808 18:39:14.457692 16659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:52057
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:39:14.476397 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:14.586818 16964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:14.587062 16964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:14.587103 16964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:14.591075 16964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:14.591135 16964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:14.591203 16964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:14.596446 16964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:14.597484 16964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:14.598531 16964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:39:14.607889 16964 server_base.cc:1034] running on GCE node
W20260808 18:39:14.607805 16973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.607807 16976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.607802 16974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:14.608433 16964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:14.609038 16964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:14.610190 16964 hybrid_clock.cc:648] HybridClock initialized: now 1786214354610161 us; error 40 us; skew 500 ppm
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:14.612897 16964 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:39:14.613734 16964 webserver.cc:460] Webserver started at http://127.4.61.194:45637/ using document root <none> and password file <none>
I20260808 18:39:14.614264 16964 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:14.614362 16964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:14.614559 16964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:14.616750 16964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "2d4d2800a0774189a162ff04a20b73f9"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "482fac56ac97e90003937e08cd5e1a94"
server_key_iv: "423d83a14189cd31dbcf2e618466e746"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.617281 16964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "2d4d2800a0774189a162ff04a20b73f9"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "482fac56ac97e90003937e08cd5e1a94"
server_key_iv: "423d83a14189cd31dbcf2e618466e746"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.620980 16964 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:39:14.623399 16989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.624576 16964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260808 18:39:14.624676 16964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "2d4d2800a0774189a162ff04a20b73f9"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "482fac56ac97e90003937e08cd5e1a94"
server_key_iv: "423d83a14189cd31dbcf2e618466e746"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.624765 16964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:14.640246 16964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:14.643687 16964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:14.643908 16964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:14.644665 16964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:14.645637 16964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:14.645685 16964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.645725 16964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:14.645747 16964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.655146 16964 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:41033
I20260808 18:39:14.655166 17179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:41033 every 8 connection(s)
I20260808 18:39:14.656263 16964 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:14.662636 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 16964
I20260808 18:39:14.662760 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:14.663048 4343 external_mini_cluster.cc:1428] Setting key 6205867c86bdc32a29b95422e77430be
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:14.670012 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.658115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:46455 (local address 127.4.61.254:44383)
0808 18:39:14.658249 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:14.658253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:14.659167 (+ 914us) server_negotiation.cc:407] Connection header received
0808 18:39:14.660472 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:14.660476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:14.660569 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:14.660663 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:14.661925 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.662532 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.663785 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.664010 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.664085 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.666624 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:14.666629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:14.666631 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:14.666660 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:14.668021 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.668478 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.668482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.668484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.668566 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.668880 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.668883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.668885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.669077 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:14.669164 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:14.669705 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 18:39:14.669831 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:39:14.670840 17182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.658538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:46455)
0808 18:39:14.659008 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:14.659053 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:14.660247 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:14.660864 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:14.660871 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:14.661262 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:14.661771 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.661785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.662665 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.662669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.663653 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.663665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.664165 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.664170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.664333 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.664880 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:14.664896 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:14.666455 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:14.668118 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.668123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.668135 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.668374 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.668651 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.668655 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.668656 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.668790 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.669178 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:14.669186 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:14.669444 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 18:39:14.669644 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 18:39:14.669975 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":122,"threads_started":1}
I20260808 18:39:14.671947 17180 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44383
I20260808 18:39:14.672173 17180 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:14.672650 17180 heartbeater.cc:511] Master 127.4.61.254:44383 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:39:14.673669 16659 ts_manager.cc:194] Registered new tserver with Master: 2d4d2800a0774189a162ff04a20b73f9 (127.4.61.194:41033)
I20260808 18:39:14.674292 16659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:46455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:39:14.690207 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:14.803699 17188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:14.803977 17188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:14.804037 17188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:14.808099 17188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:14.808154 17188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:14.808210 17188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:14.813342 17188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:14.814404 17188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:14.815397 17188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:14.824666 17196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.824765 17198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:14.824667 17201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:14.824904 17188 server_base.cc:1034] running on GCE node
I20260808 18:39:14.825289 17188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:14.825878 17188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:14.827034 17188 hybrid_clock.cc:648] HybridClock initialized: now 1786214354827017 us; error 27 us; skew 500 ppm
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:14.829648 17188 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:39:14.830505 17188 webserver.cc:460] Webserver started at http://127.4.61.195:39163/ using document root <none> and password file <none>
I20260808 18:39:14.830998 17188 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:14.831054 17188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:14.831218 17188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:14.833148 17188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "f4d129be23fb4c6bba448f3b9ef938c3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "04108162093e60cad2ab458cc7cdb4e1"
server_key_iv: "fbf917401d4892aa22a82dc972f42f72"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.833660 17188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "f4d129be23fb4c6bba448f3b9ef938c3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "04108162093e60cad2ab458cc7cdb4e1"
server_key_iv: "fbf917401d4892aa22a82dc972f42f72"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.837149 17188 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:39:14.839483 17210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.840615 17188 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:14.840720 17188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "f4d129be23fb4c6bba448f3b9ef938c3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "04108162093e60cad2ab458cc7cdb4e1"
server_key_iv: "fbf917401d4892aa22a82dc972f42f72"
server_key_version: "encryptionkey@0"
I20260808 18:39:14.840816 17188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:14.865890 17188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:14.869264 17188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:14.869475 17188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:14.870110 17188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:14.871069 17188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:14.871122 17188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.871177 17188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:14.871206 17188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:14.880245 17188 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:41431
I20260808 18:39:14.880316 17394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:41431 every 8 connection(s)
I20260808 18:39:14.881201 17188 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:14.887629 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 17188
I20260808 18:39:14.887745 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:14.888010 4343 external_mini_cluster.cc:1428] Setting key 2e3aab4823144ae0f8816fa6ede79ecb
Aug 08 18:39:14 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214354, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:14.894121 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.883096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47275 (local address 127.4.61.254:44383)
0808 18:39:14.883230 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:14.883234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:14.884278 (+ 1044us) server_negotiation.cc:407] Connection header received
0808 18:39:14.885158 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:14.885162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:14.885220 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:14.885292 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:14.886492 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.887017 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.888210 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.888503 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.888594 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.891023 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:14.891027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:14.891030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:14.891057 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:14.892226 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.892720 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.892723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.892725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.892805 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:14.893116 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:14.893120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:14.893122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:14.893296 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:14.893391 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:14.893844 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 18:39:14.893961 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:14.894907 17398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:14.883461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:47275)
0808 18:39:14.884116 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:14.884157 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:14.884952 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:14.885481 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:14.885489 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:14.885835 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:14.886349 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.886369 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.887136 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.887139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.888100 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:14.888112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:14.888644 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:14.888649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:14.888820 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:14.889406 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:14.889423 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:14.890871 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:14.892347 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.892353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.892368 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.892629 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.892888 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:14.892891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:14.892893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:14.893030 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:14.893393 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:14.893400 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:14.893630 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 18:39:14.893785 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 18:39:14.894091 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":107,"threads_started":1}
I20260808 18:39:14.895884 17396 heartbeater.cc:347] Connected to a master server at 127.4.61.254:44383
I20260808 18:39:14.896095 17396 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:14.896543 17396 heartbeater.cc:511] Master 127.4.61.254:44383 requested a full tablet report, sending...
I20260808 18:39:14.897468 16659 ts_manager.cc:194] Registered new tserver with Master: f4d129be23fb4c6bba448f3b9ef938c3 (127.4.61.195:41431)
I20260808 18:39:14.897993 16659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:47275
I20260808 18:39:14.901585 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
Entry for principal oryx/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab.
WARNING: no policy specified for oryx/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
Entry for principal oryx/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab.
WARNING: no policy specified for oryx/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
Entry for principal oryx/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab.
I20260808 18:39:14.976604 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 16753
I20260808 18:39:15.000502 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 16964
I20260808 18:39:15.024705 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 17188
I20260808 18:39:15.037918 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 16610
I20260808 18:39:15.052291 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44383
--webserver_interface=127.4.61.254
--webserver_port=33895
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:15.162477 17409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:15.162738 17409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:15.162777 17409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:15.166657 17409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:15.166704 17409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:15.166723 17409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:15.166736 17409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:15.166754 17409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:15.171880 17409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=33895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:15.172873 17409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:15.173831 17409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:15.182176 17421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.182142 17419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:15.182399 17409 server_base.cc:1034] running on GCE node
W20260808 18:39:15.182165 17418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:15.183063 17409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:15.184181 17409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:15.185360 17409 hybrid_clock.cc:648] HybridClock initialized: now 1786214355185339 us; error 30 us; skew 500 ppm
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214355, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:15.188198 17409 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:39:15.189121 17409 webserver.cc:460] Webserver started at http://127.4.61.254:33895/ using document root <none> and password file <none>
I20260808 18:39:15.189672 17409 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:15.189754 17409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:15.193640 17409 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:15.195873 17436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.197089 17409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:15.197209 17409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "d3aa0b621e354d5b9653b5e7131cafb3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "a7606e7163da52c00f907937139b91b1"
server_key_iv: "5a5b7e2044549b8a915705e708553053"
server_key_version: "encryptionkey@0"
I20260808 18:39:15.197762 17409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:15.212880 17409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:15.216010 17409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:15.216198 17409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:15.222986 17409 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:44383
I20260808 18:39:15.223001 17513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:44383 every 8 connection(s)
I20260808 18:39:15.224032 17409 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:15.228281 17514 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:39:15.228734 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 17409
I20260808 18:39:15.229231 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:40887
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:44383
--webserver_port=46667
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:39:15.230378 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Bootstrap starting.
I20260808 18:39:15.247480 17514 log.cc:824] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:15.254362 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:39:15.254711 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Bootstrap complete.
I20260808 18:39:15.258986 17514 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:15.259383 17514 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3aa0b621e354d5b9653b5e7131cafb3, State: Initialized, Role: FOLLOWER
I20260808 18:39:15.259886 17514 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:15.260007 17514 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:15.260072 17514 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:15.260165 17514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:39:15.262029 17514 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:15.262367 17514 leader_election.cc:302] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3aa0b621e354d5b9653b5e7131cafb3; no voters:
I20260808 18:39:15.262655 17514 leader_election.cc:288] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 18:39:15.262761 17519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 18:39:15.262974 17519 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [term 2 LEADER]: Becoming Leader. State: Replica: d3aa0b621e354d5b9653b5e7131cafb3, State: Running, Role: LEADER
I20260808 18:39:15.263355 17519 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } }
I20260808 18:39:15.263895 17514 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:15.264806 17521 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } } }
I20260808 18:39:15.264938 17521 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:15.265615 17534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:15.265731 17525 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3aa0b621e354d5b9653b5e7131cafb3. Latest consensus state: current_term: 2 leader_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3aa0b621e354d5b9653b5e7131cafb3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44383 } } }
I20260808 18:39:15.265906 17525 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:15.269258 17534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:15.269899 17534 catalog_manager.cc:1259] Loaded cluster ID: f1c0ae400a594a31b6bc393c6316435c
I20260808 18:39:15.269963 17534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:15.272276 17534 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:15.272927 17534 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d3aa0b621e354d5b9653b5e7131cafb3: Loaded TSK: 0
I20260808 18:39:15.274139 17534 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:39:15.350803 17516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:15.351083 17516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:15.351147 17516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:15.355254 17516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:15.355331 17516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:15.355412 17516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:15.360965 17516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.193.keytab
--principal=oryx/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:40887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=46667
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:15.362068 17516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:15.363147 17516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:15.373883 17552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.373893 17555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.373893 17553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:15.374176 17516 server_base.cc:1034] running on GCE node
I20260808 18:39:15.374629 17516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:15.375286 17516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:15.376466 17516 hybrid_clock.cc:648] HybridClock initialized: now 1786214355376444 us; error 36 us; skew 500 ppm
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214355, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:15.379197 17516 init.cc:377] Logged in from keytab as oryx/127.4.61.193@KRBTEST.COM (short username oryx)
I20260808 18:39:15.380127 17516 webserver.cc:460] Webserver started at http://127.4.61.193:46667/ using document root <none> and password file <none>
I20260808 18:39:15.380678 17516 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:15.380752 17516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:15.384799 17516 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:39:15.386978 17566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.388289 17516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:15.388401 17516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "5f0d7a6f8d9e412fb3aff09996767412"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "b9dba888372a685981c09a0e80d45f06"
server_key_iv: "ecd1280fb78d52b3c762cec9f50937ad"
server_key_version: "encryptionkey@0"
I20260808 18:39:15.388972 17516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:15.408317 17516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:15.411828 17516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:15.412046 17516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:15.412711 17516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:15.413615 17516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:15.413669 17516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.413733 17516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:15.413767 17516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.423339 17516 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:40887
I20260808 18:39:15.423364 17741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:40887 every 8 connection(s)
I20260808 18:39:15.424396 17516 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:15.426781 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 17516
I20260808 18:39:15.427275 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:41033
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:44383
--webserver_port=45637
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.438211 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.426654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:35771)
0808 18:39:15.427388 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.427447 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.428249 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.429610 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.429621 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.430167 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.430759 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.430774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.432574 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.432576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.433447 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.433456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.434498 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.434501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.434641 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.435211 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.435227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.437432 (+ 2205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":141,"threads_started":1}
W20260808 18:39:15.438702 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.426521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:35771 (local address 127.4.61.254:44383)
0808 18:39:15.426963 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.426985 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.427604 (+ 619us) server_negotiation.cc:407] Connection header received
0808 18:39:15.428664 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.428674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.429028 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.429411 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.430946 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.432441 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.433574 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.434343 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.434523 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.437731 (+ 3208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:35771: BlockingRecv error: recv got EOF from 127.4.61.193:35771 (error 108)
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":100,"threads_started":1}
W20260808 18:39:15.438859 17743 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:44383 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.61.254:44383: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.444299 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.439376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:53887)
0808 18:39:15.439540 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.439553 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.439630 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.439860 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.439863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.440013 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.440103 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.440108 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.440809 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.440812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.441364 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.441372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.441774 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.441778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.441871 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.442402 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.442418 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.444154 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98}
W20260808 18:39:15.444445 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.439467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:53887 (local address 127.4.61.254:44383)
0808 18:39:15.439581 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.439586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.439599 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:15.439713 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.439716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.439766 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.439831 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.440208 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.440704 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.441470 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.441677 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.441772 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.444325 (+ 2553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:53887: BlockingRecv error: recv got EOF from 127.4.61.193:53887 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.450103 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.444967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:35367)
0808 18:39:15.445085 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.445100 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.445180 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.445414 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.445417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.445579 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.445671 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.445677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.446454 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.446457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.447330 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.447341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.447751 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.447755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.447843 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.448264 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.448277 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.449973 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:39:15.450378 17743 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:39:15.450505 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.445039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:35367 (local address 127.4.61.254:44383)
0808 18:39:15.445139 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.445142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.445154 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:15.445280 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.445283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.445321 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.445385 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.445772 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.446362 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.447449 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.447655 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.447740 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.450107 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:35367: BlockingRecv error: recv got EOF from 127.4.61.193:35367 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 18:39:15.544221 17749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:15.544552 17749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:15.544626 17749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:15.548965 17749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:15.549052 17749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:15.549141 17749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:15.554572 17749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.194.keytab
--principal=oryx/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:41033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=45637
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:15.555712 17749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:15.556818 17749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:15.567103 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.567171 17755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.567165 17763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:15.567327 17749 server_base.cc:1034] running on GCE node
I20260808 18:39:15.567793 17749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:15.568506 17749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:15.569670 17749 hybrid_clock.cc:648] HybridClock initialized: now 1786214355569642 us; error 60 us; skew 500 ppm
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214355, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:15.572446 17749 init.cc:377] Logged in from keytab as oryx/127.4.61.194@KRBTEST.COM (short username oryx)
I20260808 18:39:15.573378 17749 webserver.cc:460] Webserver started at http://127.4.61.194:45637/ using document root <none> and password file <none>
I20260808 18:39:15.573943 17749 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:15.574033 17749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:15.577919 17749 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:15.580034 17775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.581296 17749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:15.581424 17749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "2d4d2800a0774189a162ff04a20b73f9"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "482fac56ac97e90003937e08cd5e1a94"
server_key_iv: "423d83a14189cd31dbcf2e618466e746"
server_key_version: "encryptionkey@0"
I20260808 18:39:15.582007 17749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:15.597080 17749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:15.600310 17749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:15.600521 17749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:15.601161 17749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:15.602070 17749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:15.602130 17749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.602191 17749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:15.602219 17749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.611384 17749 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:41033
I20260808 18:39:15.611410 17971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:41033 every 8 connection(s)
I20260808 18:39:15.612426 17749 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:15.615289 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 17749
I20260808 18:39:15.615724 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:41431
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:44383
--webserver_port=39163
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 18:39:15.624621 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.614415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49545 (local address 127.4.61.254:44383)
0808 18:39:15.614546 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.614550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.616086 (+ 1536us) server_negotiation.cc:407] Connection header received
0808 18:39:15.616996 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.617000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.617064 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.617162 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.618781 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.619487 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.620634 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.620856 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.620951 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.624488 (+ 3537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:49545: BlockingRecv error: recv got EOF from 127.4.61.194:49545 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:39:15.625190 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.614800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:49545)
0808 18:39:15.615910 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.615975 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.616776 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.617372 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.617382 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.617876 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.618616 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.618639 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.619612 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.619614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.620507 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.620516 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.621013 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.621018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.621206 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.621799 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.621815 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.624251 (+ 2436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":899,"thread_start_us":118,"threads_started":1}
W20260808 18:39:15.625674 17972 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:44383 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.61.254:44383: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.630847 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.626120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:56943)
0808 18:39:15.626238 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.626254 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.626354 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.626599 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.626602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.626745 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.626833 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.626838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.627548 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.627551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.628085 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.628093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.628489 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.628492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.628583 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.629048 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.629059 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.630732 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 18:39:15.630963 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.626196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:56943 (local address 127.4.61.254:44383)
0808 18:39:15.626306 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.626345 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.626359 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:15.626468 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.626470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.626511 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.626571 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.626938 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.627448 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.628190 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.628394 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.628488 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.630863 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:56943: BlockingRecv error: recv got EOF from 127.4.61.194:56943 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.635972 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.631528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:49937)
0808 18:39:15.631628 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.631642 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.631715 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.631910 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.631913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.632051 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.632119 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.632124 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.632800 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.632803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.633304 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.633311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.633714 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.633717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.633789 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.634217 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.634227 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.635848 (+ 1621us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 18:39:15.636059 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.631604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49937 (local address 127.4.61.254:44383)
0808 18:39:15.631703 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.631706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.631719 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:15.631785 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.631788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.631827 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.631887 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.632218 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.632703 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.633404 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.633619 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.633704 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.635967 (+ 2263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:49937: BlockingRecv error: recv got EOF from 127.4.61.194:49937 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 18:39:15.636379 17972 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:39:15.733527 17977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:15.733810 17977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:15.733881 17977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:15.737931 17977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:15.738025 17977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:15.738104 17977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:15.743705 17977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/krb5kdc/oryx_127.4.61.195.keytab
--principal=oryx/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:41431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=39163
--tserver_master_addrs=127.4.61.254:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:15.744855 17977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:15.745906 17977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:15.755579 17984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.755573 17983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:15.755589 17986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:15.755918 17977 server_base.cc:1034] running on GCE node
I20260808 18:39:15.756400 17977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:15.757005 17977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:15.758168 17977 hybrid_clock.cc:648] HybridClock initialized: now 1786214355758150 us; error 34 us; skew 500 ppm
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214355, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:15.760855 17977 init.cc:377] Logged in from keytab as oryx/127.4.61.195@KRBTEST.COM (short username oryx)
I20260808 18:39:15.761778 17977 webserver.cc:460] Webserver started at http://127.4.61.195:39163/ using document root <none> and password file <none>
I20260808 18:39:15.762378 17977 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:15.762471 17977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:15.766669 17977 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:39:15.768724 18002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.770016 17977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:15.770138 17977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "f4d129be23fb4c6bba448f3b9ef938c3"
format_stamp: "Formatted at 2026-08-08 18:39:14 on dist-test-slave-fgb3"
server_key: "04108162093e60cad2ab458cc7cdb4e1"
server_key_iv: "fbf917401d4892aa22a82dc972f42f72"
server_key_version: "encryptionkey@0"
I20260808 18:39:15.770732 17977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:15.816951 17977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:15.819958 17977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:15.820147 17977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:15.820763 17977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:15.821623 17977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:15.821674 17977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.821729 17977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:15.821758 17977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:15.830521 17977 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:41431
I20260808 18:39:15.830554 18184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:41431 every 8 connection(s)
I20260808 18:39:15.831517 17977 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:15.834267 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 17977
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 18:39:15.842829 17745 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.833264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50923 (local address 127.4.61.254:44383)
0808 18:39:15.833403 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.833407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.834469 (+ 1062us) server_negotiation.cc:407] Connection header received
0808 18:39:15.835549 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.835552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.835616 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.835679 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.836988 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.837666 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.839086 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.839280 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.839362 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.842696 (+ 3334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:50923: BlockingRecv error: recv got EOF from 127.4.61.195:50923 (error 108)
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":52,"spinlock_wait_cycles":8320}
I20260808 18:39:15.843487 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.833627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:50923)
0808 18:39:15.834261 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.834301 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.835326 (+ 1025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.835889 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.835896 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.836243 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.836845 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.836864 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.837790 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.837793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.838976 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.838985 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.839415 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.839419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.839588 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.840079 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.840097 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.842596 (+ 2499us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":107,"threads_started":1}
I20260808 18:39:15.843871 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.835221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.4.61.254:44383)
0808 18:39:15.835488 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.835492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.835505 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:15.835546 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.835548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.835624 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.835710 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.836431 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.837145 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.838162 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.838552 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.838651 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.839914 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:15.839919 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:15.839935 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:15.839967 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:15.841687 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:15.842131 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:15.842138 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:15.842145 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:15.842357 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:15.842611 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:15.842614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:15.842616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:15.843014 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:15.843222 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:15.843497 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 18:39:15.843741 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":183,"spinlock_wait_cycles":26112,"thread_start_us":92,"threads_started":1}
W20260808 18:39:15.843930 18185 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:44383 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.61.254:44383: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.849197 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.844327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:50365)
0808 18:39:15.844432 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.844446 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.844515 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.845138 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.845141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.845278 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.845367 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.845372 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.846137 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.846141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.846770 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.846780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.847158 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.847160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.847221 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.847594 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.847606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.849106 (+ 1500us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:39:15.849308 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.844865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50365 (local address 127.4.61.254:44383)
0808 18:39:15.844946 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.844950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.844962 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:15.844992 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.844994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.845033 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.845108 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.845469 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.846041 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.846861 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.847075 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.847150 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.849221 (+ 2071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:50365: BlockingRecv error: recv got EOF from 127.4.61.195:50365 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:15 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:15.853729 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:15.849696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:42775)
0808 18:39:15.849812 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:15.849827 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:15.849897 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:15.850060 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:15.850062 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:15.850173 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:15.850240 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.850245 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.850882 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.850884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.851384 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:15.851391 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.851753 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.851755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:15.851805 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.852134 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:15.852144 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:15.853639 (+ 1495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 18:39:15.853837 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:15.849767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:42775 (local address 127.4.61.254:44383)
0808 18:39:15.849898 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:15.849902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:15.849913 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:39:15.849955 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:15.849957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:15.849988 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:15.850039 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:15.850341 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.850800 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.851476 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:15.851670 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:15.851741 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:15.853747 (+ 2006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:42775: BlockingRecv error: recv got EOF from 127.4.61.195:42775 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 18:39:15.853955 18185 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:16.456058 18194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:16.451049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:52543)
0808 18:39:16.451347 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:16.451362 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:16.451471 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:16.451697 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:16.451700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:16.451875 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:16.451980 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.451985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.452695 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.452698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.453271 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.453279 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.453711 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.453713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.453773 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.454224 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:16.454235 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:16.455932 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
W20260808 18:39:16.456198 18196 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:16.451162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:52543 (local address 127.4.61.254:44383)
0808 18:39:16.451438 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:16.451441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:16.451455 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:16.451555 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:16.451557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:16.451600 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:16.451669 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:16.452068 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.452614 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.453380 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.453623 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.453705 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.456071 (+ 2366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:52543: BlockingRecv error: recv got EOF from 127.4.61.193:52543 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":102,"threads_started":1}
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:16.642596 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:16.636963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:44561)
0808 18:39:16.637210 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:16.637224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:16.637321 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:16.637526 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:16.637528 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:16.637710 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:16.637807 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.637812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.638692 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.638696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.639422 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.639435 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.639889 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.639893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.639988 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.640435 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:16.640446 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:16.642428 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":69,"threads_started":1}
W20260808 18:39:16.642791 18196 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:16.637047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:44561 (local address 127.4.61.254:44383)
0808 18:39:16.637206 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:16.637211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:16.637282 (+ 71us) server_negotiation.cc:407] Connection header received
0808 18:39:16.637392 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:16.637394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:16.637450 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:16.637513 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:16.637888 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.638581 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.639546 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.639777 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.639865 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.642670 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:44561: BlockingRecv error: recv got EOF from 127.4.61.194:44561 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:16 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:16.859916 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:16.854600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:60911)
0808 18:39:16.854848 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:16.854862 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:16.854958 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:16.855163 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:16.855165 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:16.855365 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:16.855490 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.855495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.856164 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.856166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.856746 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:16.856754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.857207 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.857211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:16.857329 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.857788 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:16.857799 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:16.859767 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":70,"threads_started":1}
W20260808 18:39:16.860114 18196 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:16.854660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:60911 (local address 127.4.61.254:44383)
0808 18:39:16.854790 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:16.854793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:16.854921 (+ 128us) server_negotiation.cc:407] Connection header received
0808 18:39:16.855026 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:16.855028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:16.855073 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:16.855138 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:16.855574 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.856088 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.856847 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:16.857080 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:16.857155 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:16.859901 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:60911: BlockingRecv error: recv got EOF from 127.4.61.195:60911 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:17.462745 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:17.456921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:39601)
0808 18:39:17.457203 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:17.457218 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:17.457311 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:17.457537 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:17.457539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:17.457722 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:17.457822 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.457827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.458796 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.458800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.459562 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.459575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.459999 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.460001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.460067 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.460648 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:17.460661 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:17.462600 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
W20260808 18:39:17.462908 18211 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:17.457000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:39601 (local address 127.4.61.254:44383)
0808 18:39:17.457265 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:17.457269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:17.457283 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:17.457388 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:17.457390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:17.457433 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:17.457509 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:17.457975 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.458675 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.459676 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.459910 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.459989 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.462758 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:39601: BlockingRecv error: recv got EOF from 127.4.61.193:39601 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":86,"threads_started":1}
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:17.649127 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:17.643456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:60763)
0808 18:39:17.643762 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:17.643776 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:17.643919 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:17.644195 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:17.644198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:17.644418 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:17.644549 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.644557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.645378 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.645381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.646030 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.646042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.646601 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.646605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.646676 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.647208 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:17.647222 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:17.648981 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":86,"threads_started":1}
W20260808 18:39:17.649245 18211 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:17.643542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:60763 (local address 127.4.61.254:44383)
0808 18:39:17.643731 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:17.643736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:17.643854 (+ 118us) server_negotiation.cc:407] Connection header received
0808 18:39:17.644013 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:17.644016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:17.644074 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:17.644149 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:17.644680 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.645229 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.646170 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.646469 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.646560 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.649125 (+ 2565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:60763: BlockingRecv error: recv got EOF from 127.4.61.194:60763 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:17 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:17.866140 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:17.860670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:52749)
0808 18:39:17.861012 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:17.861027 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:17.861147 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:17.861388 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:17.861391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:17.861594 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:17.861693 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.861699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.862483 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.862487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.863053 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:17.863061 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.863521 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.863525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:17.863618 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.864143 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:17.864158 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:17.865988 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":109,"threads_started":1}
W20260808 18:39:17.866235 18211 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:17.860886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:52749 (local address 127.4.61.254:44383)
0808 18:39:17.861011 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:17.861016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:17.861093 (+ 77us) server_negotiation.cc:407] Connection header received
0808 18:39:17.861232 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:17.861235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:17.861286 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:17.861350 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:17.861808 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.862382 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.863164 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:17.863394 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:17.863492 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:17.866131 (+ 2639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:52749: BlockingRecv error: recv got EOF from 127.4.61.195:52749 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:18.469117 18215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:18.463538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:59735)
0808 18:39:18.463809 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:18.463823 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:18.463920 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:18.464284 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:18.464286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:18.464476 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:18.464577 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.464582 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.465460 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.465463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.466087 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.466097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.466631 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.466636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.466726 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.467240 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:18.467253 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:18.468999 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":72,"threads_started":1}
W20260808 18:39:18.469272 18216 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:18.463632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:59735 (local address 127.4.61.254:44383)
0808 18:39:18.463907 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:18.463910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:18.463924 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:18.464059 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:18.464063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:18.464163 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:18.464259 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:18.464691 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.465340 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.466200 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.466512 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.466612 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.469130 (+ 2518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:59735: BlockingRecv error: recv got EOF from 127.4.61.193:59735 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:18.655344 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:18.649929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:39475)
0808 18:39:18.650232 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:18.650246 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:18.650383 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:18.650620 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:18.650621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:18.650815 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:18.650920 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.650926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.651842 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.651845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.652406 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.652416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.652888 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.652892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.652990 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.653459 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:18.653470 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:18.655189 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":97,"threads_started":1}
W20260808 18:39:18.655444 18216 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:18.650050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:39475 (local address 127.4.61.254:44383)
0808 18:39:18.650185 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:18.650189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:18.650327 (+ 138us) server_negotiation.cc:407] Connection header received
0808 18:39:18.650473 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:18.650475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:18.650523 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:18.650591 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:18.651037 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.651718 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.652506 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.652771 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.652864 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.655328 (+ 2464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:39475: BlockingRecv error: recv got EOF from 127.4.61.194:39475 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:18 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:18.872345 18220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:18.866908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:38671)
0808 18:39:18.867230 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:18.867245 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:18.867361 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:18.867622 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:18.867625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:18.867833 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:18.867943 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.867949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.868705 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.868709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.869301 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:18.869309 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.869751 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.869755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:18.869841 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.870442 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:18.870456 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:18.872216 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
W20260808 18:39:18.872524 18216 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:18.866982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:38671 (local address 127.4.61.254:44383)
0808 18:39:18.867115 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:18.867120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:18.867324 (+ 204us) server_negotiation.cc:407] Connection header received
0808 18:39:18.867467 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:18.867469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:18.867517 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:18.867584 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:18.868067 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.868599 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.869420 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:18.869646 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:18.869733 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:18.872405 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:38671: BlockingRecv error: recv got EOF from 127.4.61.195:38671 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:19.478434 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:19.469870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:52729)
0808 18:39:19.470177 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:19.470191 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:19.470286 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:19.470552 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:19.470555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:19.470732 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:19.470833 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.470838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.471551 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.471553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.472110 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.472117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.472622 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.472625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.472713 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.476560 (+ 3847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:19.476573 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:19.478269 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":116,"threads_started":1}
W20260808 18:39:19.478655 18223 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:19.469941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:52729 (local address 127.4.61.254:44383)
0808 18:39:19.470214 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:19.470218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:19.470233 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:39:19.470402 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:19.470404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:19.470451 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:19.470525 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:19.470942 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.471466 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.472217 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.472494 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.472595 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.478522 (+ 5927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:52729: BlockingRecv error: recv got EOF from 127.4.61.193:52729 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":91,"threads_started":1}
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:19.661572 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:19.656205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:43539)
0808 18:39:19.656507 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:19.656521 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:19.656621 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:19.656836 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:19.656838 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:19.657021 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:19.657125 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.657131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.657880 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.657884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.658506 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.658516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.659060 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.659064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.659155 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.659745 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:19.659759 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:19.661452 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":111,"threads_started":1}
W20260808 18:39:19.661681 18223 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:19.656333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:43539 (local address 127.4.61.254:44383)
0808 18:39:19.656469 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:19.656473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:19.656581 (+ 108us) server_negotiation.cc:407] Connection header received
0808 18:39:19.656693 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:19.656696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:19.656737 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:19.656809 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:19.657212 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.657768 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.658624 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.658914 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.659015 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.661583 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:43539: BlockingRecv error: recv got EOF from 127.4.61.194:43539 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:19 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:19.878670 18225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:19.873193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:47145)
0808 18:39:19.873508 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:19.873527 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:19.873631 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:19.874004 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:19.874007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:19.874196 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:19.874348 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.874355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.875208 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.875211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.875795 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:19.875804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.876217 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.876219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:19.876278 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.876774 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:19.876786 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:19.878550 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":117,"threads_started":1}
W20260808 18:39:19.878790 18223 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:19.873296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47145 (local address 127.4.61.254:44383)
0808 18:39:19.873445 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:19.873449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:19.873587 (+ 138us) server_negotiation.cc:407] Connection header received
0808 18:39:19.873780 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:19.873782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:19.873839 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:19.873926 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:19.874457 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.875064 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.875900 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:19.876127 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:19.876220 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:19.878687 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:47145: BlockingRecv error: recv got EOF from 127.4.61.195:47145 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:20.484373 18227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:20.479246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:60909)
0808 18:39:20.479597 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:20.479610 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:20.479709 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:20.479935 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:20.479937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:20.480121 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:20.480223 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.480228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.480927 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.480929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.481492 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.481500 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.481864 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.481867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.481923 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.482487 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:20.482499 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:20.484242 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":124,"threads_started":1}
W20260808 18:39:20.484630 18228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:20.479332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:60909 (local address 127.4.61.254:44383)
0808 18:39:20.479615 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:20.479618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:20.479670 (+ 52us) server_negotiation.cc:407] Connection header received
0808 18:39:20.479790 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:20.479792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:20.479834 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:20.479912 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:20.480307 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.480843 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.481569 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.481788 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.481855 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.484492 (+ 2637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:60909: BlockingRecv error: recv got EOF from 127.4.61.193:60909 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":83,"threads_started":1}
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:20.667766 18229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:20.662371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:49327)
0808 18:39:20.662637 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:20.662652 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:20.662744 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:20.662955 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:20.662957 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:20.663143 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:20.663239 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.663245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.663938 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.663941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.664530 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.664538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.664958 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.664960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.665037 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.665552 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:20.665563 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:20.667629 (+ 2066us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":86,"threads_started":1}
W20260808 18:39:20.667840 18228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:20.662514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49327 (local address 127.4.61.254:44383)
0808 18:39:20.662638 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:20.662642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:20.662699 (+ 57us) server_negotiation.cc:407] Connection header received
0808 18:39:20.662816 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:20.662818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:20.662860 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:20.662927 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:20.663329 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.663847 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.664633 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.664865 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.664947 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.667740 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:49327: BlockingRecv error: recv got EOF from 127.4.61.194:49327 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:20 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:20.884795 18231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:20.879468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:54015)
0808 18:39:20.879767 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:20.879782 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:20.879892 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:20.880146 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:20.880150 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:20.880358 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:20.880454 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.880460 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.881217 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.881221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.881805 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:20.881813 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.882303 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.882307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:20.882424 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.882911 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:20.882923 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:20.884646 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
W20260808 18:39:20.884886 18228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:20.879556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:54015 (local address 127.4.61.254:44383)
0808 18:39:20.879712 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:20.879717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:20.879853 (+ 136us) server_negotiation.cc:407] Connection header received
0808 18:39:20.879985 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:20.879989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:20.880040 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:20.880107 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:20.880573 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.881111 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.881939 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:20.882174 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:20.882277 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:20.884786 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:54015: BlockingRecv error: recv got EOF from 127.4.61.195:54015 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:21.495111 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:21.485345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:51921)
0808 18:39:21.485747 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:21.485760 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:21.485867 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:21.486184 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:21.486187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:21.486460 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:21.486589 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.486595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.487349 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.487352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.487904 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.487913 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.488405 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.488409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.488481 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.493127 (+ 4646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:21.493141 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:21.494984 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":98,"threads_started":1}
W20260808 18:39:21.495297 18233 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:21.485411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51921 (local address 127.4.61.254:44383)
0808 18:39:21.485658 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:21.485663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:21.485838 (+ 175us) server_negotiation.cc:407] Connection header received
0808 18:39:21.485951 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:21.485954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:21.486006 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:21.486089 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:21.486696 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.487232 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.488041 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.488279 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.488363 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.495145 (+ 6782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:51921: BlockingRecv error: recv got EOF from 127.4.61.193:51921 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":58,"threads_started":1}
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:21.674140 18235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:21.668595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:53429)
0808 18:39:21.668883 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:21.668898 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:21.669012 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:21.669307 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:21.669309 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:21.669508 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:21.669611 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.669617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.670360 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.670362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.670906 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.670912 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.671344 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.671346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.671401 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.671869 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:21.671882 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:21.674016 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
W20260808 18:39:21.674264 18233 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:21.668664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:53429 (local address 127.4.61.254:44383)
0808 18:39:21.668840 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:21.668845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:21.668968 (+ 123us) server_negotiation.cc:407] Connection header received
0808 18:39:21.669147 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:21.669150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:21.669205 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:21.669280 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:21.669703 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.670240 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.671017 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.671251 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.671338 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.674157 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:53429: BlockingRecv error: recv got EOF from 127.4.61.194:53429 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:21 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:21.890640 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:21.885507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:42399)
0808 18:39:21.885767 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:21.885791 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:21.885890 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:21.886113 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:21.886115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:21.886364 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:21.886481 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.886488 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.887175 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.887177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.887725 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:21.887731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.888146 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.888148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:21.888205 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.888660 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:21.888671 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:21.890483 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":79,"threads_started":1}
W20260808 18:39:21.890722 18233 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:21.885576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:42399 (local address 127.4.61.254:44383)
0808 18:39:21.885700 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:21.885704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:21.885847 (+ 143us) server_negotiation.cc:407] Connection header received
0808 18:39:21.885967 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:21.885970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:21.886018 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:21.886088 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:21.886573 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.887093 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.887833 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:21.888061 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:21.888139 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:21.890621 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:42399: BlockingRecv error: recv got EOF from 127.4.61.195:42399 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:22.500847 18241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:22.495871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:38041)
0808 18:39:22.496212 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:22.496225 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:22.496326 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:22.496546 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:22.496548 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:22.496729 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:22.496829 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.496834 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.497509 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.497512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.498085 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.498092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.498496 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.498499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.498561 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.499038 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:22.499048 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:22.500731 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":92,"threads_started":1}
W20260808 18:39:22.500991 18242 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:22.495965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38041 (local address 127.4.61.254:44383)
0808 18:39:22.496223 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:22.496226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:22.496293 (+ 67us) server_negotiation.cc:407] Connection header received
0808 18:39:22.496396 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:22.496398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:22.496443 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:22.496517 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:22.496911 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.497435 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.498168 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.498416 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.498487 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.500868 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:38041: BlockingRecv error: recv got EOF from 127.4.61.193:38041 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:22.680603 18243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:22.674952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:36503)
0808 18:39:22.675268 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:22.675283 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:22.675405 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:22.675652 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:22.675655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:22.675874 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:22.675974 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.675980 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.676744 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.676755 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.677308 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.677316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.677744 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.677757 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.677843 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.678422 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:22.678435 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:22.680485 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":75,"threads_started":1}
W20260808 18:39:22.680740 18242 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:22.675017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:36503 (local address 127.4.61.254:44383)
0808 18:39:22.675172 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:22.675176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:22.675378 (+ 202us) server_negotiation.cc:407] Connection header received
0808 18:39:22.675497 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:22.675500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:22.675547 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:22.675614 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:22.676093 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.676637 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.677423 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.677643 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.677729 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.680622 (+ 2893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:36503: BlockingRecv error: recv got EOF from 127.4.61.194:36503 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:22 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:22.897472 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:22.891677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:42649)
0808 18:39:22.891989 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:22.892003 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:22.892139 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:22.892408 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:22.892410 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:22.892615 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:22.892715 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.892721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.893564 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.893567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.894119 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:22.894127 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.894704 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.894706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:22.894769 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.895237 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:22.895248 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:22.897306 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":75,"threads_started":1}
W20260808 18:39:22.897574 18242 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:22.891786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:42649 (local address 127.4.61.254:44383)
0808 18:39:22.891971 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:22.891976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:22.892076 (+ 100us) server_negotiation.cc:407] Connection header received
0808 18:39:22.892228 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:22.892231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:22.892294 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:22.892373 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:22.892805 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.893471 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.894278 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:22.894605 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:22.894697 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:22.897473 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:42649: BlockingRecv error: recv got EOF from 127.4.61.195:42649 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:23.507182 18247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:23.501699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:44667)
0808 18:39:23.501962 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:23.501975 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:23.502087 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:23.502390 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:23.502394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:23.502595 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:23.502697 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.502703 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.503479 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.503483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.504049 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.504059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.504508 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.504512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.504597 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.505080 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:23.505093 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:23.507021 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":74,"threads_started":1}
W20260808 18:39:23.507293 18248 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:23.501833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:44667 (local address 127.4.61.254:44383)
0808 18:39:23.502068 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:23.502072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:23.502086 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:23.502167 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:23.502170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:23.502214 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:23.502305 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:23.502818 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.503369 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.504161 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.504400 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.504489 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.507172 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:44667: BlockingRecv error: recv got EOF from 127.4.61.193:44667 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:23.687223 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:23.681440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:47873)
0808 18:39:23.681742 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:23.681754 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:23.681868 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:23.682115 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:23.682118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:23.682366 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:23.682477 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.682484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.683363 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.683367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.683958 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.683969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.684564 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.684568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.684646 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.685193 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:23.685205 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:23.687059 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":86,"threads_started":1}
W20260808 18:39:23.687345 18248 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:23.681524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:47873 (local address 127.4.61.254:44383)
0808 18:39:23.681675 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:23.681680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:23.681823 (+ 143us) server_negotiation.cc:407] Connection header received
0808 18:39:23.681956 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:23.681960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:23.682008 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:23.682076 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:23.682590 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.683256 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.684101 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.684448 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.684542 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.687217 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:47873: BlockingRecv error: recv got EOF from 127.4.61.194:47873 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:23 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:23.903594 18250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:23.898216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:54731)
0808 18:39:23.898510 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:23.898525 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:23.898644 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:23.898895 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:23.898898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:23.899106 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:23.899202 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.899208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.899970 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.899974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.900547 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:23.900555 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.901018 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.901022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:23.901106 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.901572 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:23.901584 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:23.903448 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":116,"threads_started":1}
W20260808 18:39:23.903676 18248 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:23.898357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:54731 (local address 127.4.61.254:44383)
0808 18:39:23.898499 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:23.898503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:23.898587 (+ 84us) server_negotiation.cc:407] Connection header received
0808 18:39:23.898741 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:23.898744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:23.898794 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:23.898859 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:23.899325 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.899858 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.900657 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:23.900888 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:23.900998 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:23.903574 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:54731: BlockingRecv error: recv got EOF from 127.4.61.195:54731 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:24.516649 18251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:24.507973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:38189)
0808 18:39:24.508236 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:24.508249 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:24.508334 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:24.508554 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:24.508556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:24.508737 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:24.508840 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.508845 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.509549 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.509551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.510140 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.510149 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.510554 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.510557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.510622 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.514146 (+ 3524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:24.514160 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:24.516461 (+ 2301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":77,"threads_started":1}
W20260808 18:39:24.516954 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:24.508060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38189 (local address 127.4.61.254:44383)
0808 18:39:24.508283 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:24.508287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:24.508300 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:24.508411 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:24.508413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:24.508454 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:24.508532 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:24.508922 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.509468 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.510227 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.510474 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.510545 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.516822 (+ 6277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:38189: BlockingRecv error: recv got EOF from 127.4.61.193:38189 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":67,"threads_started":1}
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:24.693926 18253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:24.688146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:60527)
0808 18:39:24.688450 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:24.688463 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:24.688563 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:24.688803 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:24.688805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:24.688986 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:24.689094 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.689100 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.689996 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.690001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.690801 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.690816 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.691341 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.691344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.691416 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.691910 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:24.691923 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:24.693782 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":115,"threads_started":1}
W20260808 18:39:24.694024 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:24.688293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:60527 (local address 127.4.61.254:44383)
0808 18:39:24.688452 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:24.688456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:24.688527 (+ 71us) server_negotiation.cc:407] Connection header received
0808 18:39:24.688640 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:24.688643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:24.688692 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:24.688778 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:24.689250 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.689883 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.690944 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.691187 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.691279 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.693924 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:60527: BlockingRecv error: recv got EOF from 127.4.61.194:60527 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:24 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:24.909835 18255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:24.904473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:59049)
0808 18:39:24.904731 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:24.904744 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:24.904848 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:24.905057 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:24.905059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:24.905241 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:24.905347 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.905352 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.906018 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.906020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.906611 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:24.906619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.907097 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.907100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:24.907171 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.907721 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:24.907740 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:24.909708 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":75,"threads_started":1}
W20260808 18:39:24.909960 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:24.904563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:59049 (local address 127.4.61.254:44383)
0808 18:39:24.904718 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:24.904722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:24.904808 (+ 86us) server_negotiation.cc:407] Connection header received
0808 18:39:24.904919 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:24.904921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:24.904967 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:24.905032 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:24.905430 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.905942 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.906750 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:24.906975 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:24.907070 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:24.909841 (+ 2771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:59049: BlockingRecv error: recv got EOF from 127.4.61.195:59049 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:25.523396 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:25.517764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:58593)
0808 18:39:25.518069 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:25.518084 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:25.518193 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:25.518453 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:25.518455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:25.518681 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:25.518819 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.518828 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.519762 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.519765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.520458 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.520469 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.520878 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.520880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.520939 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.521449 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:25.521464 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:25.523275 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":90,"threads_started":1}
W20260808 18:39:25.523584 18259 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:25.517839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:58593 (local address 127.4.61.254:44383)
0808 18:39:25.518102 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:25.518106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:25.518145 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:39:25.518273 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:25.518275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:25.518336 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:25.518414 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:25.518947 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.519641 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.520560 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.520793 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.520871 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.523440 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:58593: BlockingRecv error: recv got EOF from 127.4.61.193:58593 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":70,"threads_started":1}
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:25.700143 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:25.694871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:51103)
0808 18:39:25.695280 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:25.695295 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:25.695404 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:25.695638 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:25.695640 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:25.695833 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:25.695934 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.695939 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.696681 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.696683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.697257 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.697265 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.697646 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.697649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.697708 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.698232 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:25.698246 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:25.700021 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":110,"threads_started":1}
W20260808 18:39:25.700292 18259 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:25.694930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:51103 (local address 127.4.61.254:44383)
0808 18:39:25.695093 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:25.695098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:25.695363 (+ 265us) server_negotiation.cc:407] Connection header received
0808 18:39:25.695489 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:25.695491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:25.695541 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:25.695613 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:25.696038 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.696580 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.697358 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.697566 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.697635 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.700174 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:51103: BlockingRecv error: recv got EOF from 127.4.61.194:51103 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:25 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:25.915980 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:25.910602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:36375)
0808 18:39:25.910874 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:25.910887 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:25.910984 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:25.911261 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:25.911263 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:25.911462 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:25.911566 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.911572 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.912320 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.912324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.912947 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:25.912959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.913459 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.913463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:25.913554 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.914059 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:25.914072 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:25.915831 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":84,"threads_started":1}
W20260808 18:39:25.916078 18259 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:25.910749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:36375 (local address 127.4.61.254:44383)
0808 18:39:25.910884 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:25.910888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:25.910950 (+ 62us) server_negotiation.cc:407] Connection header received
0808 18:39:25.911057 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:25.911059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:25.911104 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:25.911172 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:25.911664 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.912189 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.913052 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:25.913327 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:25.913422 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:25.915979 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:36375: BlockingRecv error: recv got EOF from 127.4.61.195:36375 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:26.529317 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:26.524178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:39943)
0808 18:39:26.524454 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:26.524468 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:26.524564 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:26.524764 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:26.524766 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:26.524948 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:26.525046 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.525051 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.525766 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.525769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.526414 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.526425 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.526852 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.526854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.526918 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.527378 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:26.527389 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:26.529186 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
W20260808 18:39:26.529506 18265 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:26.524282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:39943 (local address 127.4.61.254:44383)
0808 18:39:26.524558 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:26.524562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:26.524574 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:39:26.524629 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:26.524631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:26.524673 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:26.524749 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:26.525135 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.525676 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.526532 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.526760 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.526838 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.529371 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:39943: BlockingRecv error: recv got EOF from 127.4.61.193:39943 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:26.706578 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:26.700913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:40343)
0808 18:39:26.701241 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:26.701254 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:26.701371 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:26.701631 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:26.701634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:26.701853 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:26.701954 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.701961 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.702829 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.702833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.703409 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.703418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.703860 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.703864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.703949 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.704457 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:26.704470 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:26.706404 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":85,"threads_started":1}
W20260808 18:39:26.706686 18265 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:26.701001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:40343 (local address 127.4.61.254:44383)
0808 18:39:26.701142 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:26.701147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:26.701325 (+ 178us) server_negotiation.cc:407] Connection header received
0808 18:39:26.701458 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:26.701461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:26.701510 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:26.701590 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:26.702089 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.702710 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.703524 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.703745 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.703836 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.706569 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:40343: BlockingRecv error: recv got EOF from 127.4.61.194:40343 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:26 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:26.922052 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:26.916751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:35617)
0808 18:39:26.917004 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:26.917017 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:26.917120 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:26.917365 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:26.917367 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:26.917553 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:26.917656 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.917661 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.918390 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.918392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.919010 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:26.919024 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.919556 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.919559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:26.919631 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.920196 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:26.920208 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:26.921922 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":74,"threads_started":1}
W20260808 18:39:26.922142 18265 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:26.916849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:35617 (local address 127.4.61.254:44383)
0808 18:39:26.916973 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:26.916977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:26.917111 (+ 134us) server_negotiation.cc:407] Connection header received
0808 18:39:26.917190 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:26.917192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:26.917266 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:26.917336 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:26.917744 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.918294 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.919138 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:26.919427 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:26.919510 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:26.922047 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:35617: BlockingRecv error: recv got EOF from 127.4.61.195:35617 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:27.535277 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:27.530064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:34857)
0808 18:39:27.530380 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:27.530396 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:27.530496 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:27.530718 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:27.530720 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:27.530901 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:27.531015 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.531020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.531736 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.531739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.532303 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.532310 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.532717 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.532719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.532777 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.533278 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:27.533290 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:27.535125 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":71,"threads_started":1}
W20260808 18:39:27.535378 18271 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:27.530190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:34857 (local address 127.4.61.254:44383)
0808 18:39:27.530461 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:27.530464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:27.530477 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:27.530573 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:27.530575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:27.530617 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:27.530691 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:27.531110 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.531652 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.532402 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.532631 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.532708 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.535264 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:34857: BlockingRecv error: recv got EOF from 127.4.61.193:34857 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":110,"threads_started":1}
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:27.713246 18275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:27.707553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:56595)
0808 18:39:27.707861 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:27.707877 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:27.708008 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:27.708264 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:27.708267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:27.708484 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:27.708587 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.708594 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.709360 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.709364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.709936 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.709945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.710474 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.710480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.710590 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.711184 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:27.711197 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:27.713092 (+ 1895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
W20260808 18:39:27.713340 18271 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:27.707673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:56595 (local address 127.4.61.254:44383)
0808 18:39:27.707834 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:27.707839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:27.707950 (+ 111us) server_negotiation.cc:407] Connection header received
0808 18:39:27.708104 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:27.708106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:27.708153 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:27.708221 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:27.708714 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.709248 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.710061 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.710302 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.710442 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.713240 (+ 2798us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:56595: BlockingRecv error: recv got EOF from 127.4.61.194:56595 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:27 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:27.928287 18277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:27.922829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:34427)
0808 18:39:27.923129 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:27.923145 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:27.923264 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:27.923554 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:27.923557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:27.923740 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:27.923847 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.923853 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.924647 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.924650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.925235 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:27.925245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.925677 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.925679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:27.925737 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.926264 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:27.926278 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:27.928130 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
W20260808 18:39:27.928393 18271 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:27.922907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:34427 (local address 127.4.61.254:44383)
0808 18:39:27.923070 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:27.923075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:27.923238 (+ 163us) server_negotiation.cc:407] Connection header received
0808 18:39:27.923394 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:27.923398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:27.923452 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:27.923523 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:27.923965 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.924524 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.925353 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:27.925590 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:27.925668 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:27.928281 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:34427: BlockingRecv error: recv got EOF from 127.4.61.195:34427 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:28.542204 18278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:28.536421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:38991)
0808 18:39:28.536748 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:28.536764 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:28.536872 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:28.537181 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:28.537184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:28.537387 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:28.537495 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.537501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.538280 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.538284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.539112 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.539125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.539618 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.539621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.539691 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.540172 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:28.540184 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:28.542069 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":95,"threads_started":1}
W20260808 18:39:28.542348 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:28.536559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38991 (local address 127.4.61.254:44383)
0808 18:39:28.536800 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:28.536804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:28.536818 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:39:28.536973 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:28.536976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:28.537022 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:28.537103 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:28.537597 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.538146 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.539230 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.539517 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.539599 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.542209 (+ 2610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:38991: BlockingRecv error: recv got EOF from 127.4.61.193:38991 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:28.719514 18281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:28.714117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:49645)
0808 18:39:28.714425 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:28.714443 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:28.714573 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:28.714887 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:28.714890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:28.715077 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:28.715189 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.715195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.715930 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.715933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.716537 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.716546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.716910 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.716912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.716971 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.717421 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:28.717435 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:28.719338 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":76,"threads_started":1}
W20260808 18:39:28.719580 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:28.714288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49645 (local address 127.4.61.254:44383)
0808 18:39:28.714427 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:28.714439 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:28.714528 (+ 89us) server_negotiation.cc:407] Connection header received
0808 18:39:28.714694 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:28.714698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:28.714751 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:28.714810 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:28.715313 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.715836 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.716623 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.716832 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.716900 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.719479 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:49645: BlockingRecv error: recv got EOF from 127.4.61.194:49645 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:28 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:28.934460 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:28.929058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:50685)
0808 18:39:28.929334 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:28.929347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:28.929450 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:28.929662 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:28.929664 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:28.929883 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:28.929983 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.929989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.930746 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.930750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.931350 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:28.931359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.931853 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.931856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:28.931933 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.932484 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:28.932496 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:28.934306 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
W20260808 18:39:28.934661 18280 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:28.929134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50685 (local address 127.4.61.254:44383)
0808 18:39:28.929287 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:28.929292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:28.929410 (+ 118us) server_negotiation.cc:407] Connection header received
0808 18:39:28.929521 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:28.929523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:28.929572 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:28.929637 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:28.930076 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.930630 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.931487 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:28.931735 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:28.931834 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:28.934526 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:50685: BlockingRecv error: recv got EOF from 127.4.61.195:50685 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:29.552080 18288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:29.543174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:33093)
0808 18:39:29.543570 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:29.543588 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:29.543704 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:29.544004 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:29.544007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:29.544226 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:29.544367 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.544376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.545138 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.545141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.545735 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.545745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.546135 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.546137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.546197 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.549976 (+ 3779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:29.549989 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:29.551903 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":92,"threads_started":1}
W20260808 18:39:29.552188 18290 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:29.543261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:33093 (local address 127.4.61.254:44383)
0808 18:39:29.543611 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:29.543615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:29.543647 (+ 32us) server_negotiation.cc:407] Connection header received
0808 18:39:29.543808 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:29.543811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:29.543873 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:29.543963 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:29.544483 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.545023 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.545828 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.546054 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.546128 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.552065 (+ 5937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:33093: BlockingRecv error: recv got EOF from 127.4.61.193:33093 (error 108)
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":86,"threads_started":1}
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:29.725425 18291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:29.720303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:50525)
0808 18:39:29.720584 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:29.720597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:29.720697 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:29.720910 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:29.720912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:29.721096 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:29.721197 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.721203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.721911 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.721914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.722586 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.722598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.722985 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.722988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.723048 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.723521 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:29.723532 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:29.725292 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
W20260808 18:39:29.725502 18290 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:29.720371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:50525 (local address 127.4.61.254:44383)
0808 18:39:29.720506 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:29.720510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:29.720658 (+ 148us) server_negotiation.cc:407] Connection header received
0808 18:39:29.720772 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:29.720775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:29.720816 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:29.720881 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:29.721288 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.721801 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.722680 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.722902 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.722976 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.725404 (+ 2428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:50525: BlockingRecv error: recv got EOF from 127.4.61.194:50525 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:29 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.195@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:29.940871 18292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:29.935459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.195:48085)
0808 18:39:29.935776 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:29.935789 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:29.935917 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:29.936177 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:29.936180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:29.936386 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:29.936488 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.936495 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.937323 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.937327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.937899 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:29.937908 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.938414 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.938418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:29.938507 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.938967 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:29.938979 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:29.940719 (+ 1740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":117,"threads_started":1}
W20260808 18:39:29.940968 18290 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:29.935567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:48085 (local address 127.4.61.254:44383)
0808 18:39:29.935710 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:29.935715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:29.935872 (+ 157us) server_negotiation.cc:407] Connection header received
0808 18:39:29.936007 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:29.936010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:29.936067 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:29.936131 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:29.936610 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.937211 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.938024 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:29.938259 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:29.938381 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:29.940863 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.195:48085: BlockingRecv error: recv got EOF from 127.4.61.195:48085 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 18:39:30 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:30 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.193@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:30.558228 18293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:30.552973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.193:45871)
0808 18:39:30.553241 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:30.553256 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:30.553346 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:30.553575 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:30.553577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:30.553755 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:30.553863 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:30.553868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.554690 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.554693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:30.555257 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:30.555266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.555720 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.555724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:30.555802 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:30.556325 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:30.556337 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:30.558104 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
W20260808 18:39:30.558432 18294 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:30.553053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:45871 (local address 127.4.61.254:44383)
0808 18:39:30.553338 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:30.553343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:30.553356 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:39:30.553443 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:30.553445 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:30.553488 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:30.553563 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:30.553982 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.554606 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.555377 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.555610 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.555689 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:30.558264 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.193:45871: BlockingRecv error: recv got EOF from 127.4.61.193:45871 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":82,"threads_started":1}
Aug 08 18:39:30 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 18:39:30 dist-test-slave-fgb3 krb5kdc[16593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.61.194@KRBTEST.COM for oryx/127.4.61.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 18:39:30.732015 18295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:30.726456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44383 (local address 127.4.61.194:43255)
0808 18:39:30.726896 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:30.726908 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:30.727011 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:30.727315 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:30.727318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:30.727569 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:30.727673 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:30.727680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.728399 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.728401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:30.728954 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:30.728960 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.729461 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.729464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:30.729537 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:30.730006 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:30.730017 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:30.731899 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.61.254:44383: Server oryx/127.4.61.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":94,"threads_started":1}
W20260808 18:39:30.732164 18294 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:30.726603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:43255 (local address 127.4.61.254:44383)
0808 18:39:30.726761 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:30.726766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:30.726975 (+ 209us) server_negotiation.cc:407] Connection header received
0808 18:39:30.727098 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:30.727101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:30.727157 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:30.727236 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:30.727779 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.728312 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.729075 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:30.729320 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:30.729414 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:30.732043 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.61.194:43255: BlockingRecv error: recv got EOF from 127.4.61.194:43255 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:39:30.841040 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 17516
I20260808 18:39:30.856293 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 17749
I20260808 18:39:30.868502 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 17977
I20260808 18:39:30.876880 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 17409
2026-08-08T18:39:30Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18159 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T18:39:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:30Z Disabled control of system clock
I20260808 18:39:30.915005 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35293
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:35293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 18:39:31.026875 18303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:31.027161 18303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:31.027195 18303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:31.031184 18303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:31.031250 18303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:31.031265 18303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:31.031280 18303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:31.031294 18303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:31.036626 18303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:35293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:31.037937 18303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:31.039407 18303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:39:31.048187 18303 server_base.cc:1034] running on GCE node
W20260808 18:39:31.048127 18313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.048127 18311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.048190 18315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.049057 18303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:31.050117 18303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:31.051329 18303 hybrid_clock.cc:648] HybridClock initialized: now 1786214371051303 us; error 32 us; skew 500 ppm
I20260808 18:39:31.053239 18303 webserver.cc:460] Webserver started at http://127.4.61.254:44621/ using document root <none> and password file <none>
I20260808 18:39:31.053790 18303 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:31.053853 18303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:31.054029 18303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:31.056206 18303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "61c8f9cac4e000860eaff54fbb5410ae"
server_key_iv: "a93c305db7ab89597a82f0e5620f0d4f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.056780 18303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "61c8f9cac4e000860eaff54fbb5410ae"
server_key_iv: "a93c305db7ab89597a82f0e5620f0d4f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.060678 18303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:39:31.063177 18324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.064426 18303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:31.064554 18303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "61c8f9cac4e000860eaff54fbb5410ae"
server_key_iv: "a93c305db7ab89597a82f0e5620f0d4f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.064656 18303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:31.075948 18303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:31.076630 18303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:31.076786 18303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:31.083782 18303 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:35293
I20260808 18:39:31.083837 18407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:35293 every 8 connection(s)
I20260808 18:39:31.084816 18303 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:31.088037 18409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:31.090852 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 18303
I20260808 18:39:31.090973 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:31.091245 4343 external_mini_cluster.cc:1428] Setting key 4be2d3e0eeca2aac2485df65917e3a84
I20260808 18:39:31.093878 18409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37: Bootstrap starting.
I20260808 18:39:31.096033 18409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:31.096899 18409 log.cc:824] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:31.099033 18409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37: No bootstrap required, opened a new log
I20260808 18:39:31.100886 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.092651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.4.61.254:35293)
0808 18:39:31.093294 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.093308 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.093343 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:39:31.093961 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.093978 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.094421 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.094723 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.095148 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.096103 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.097291 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.097893 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.098025 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.099022 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:31.099027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:31.099040 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:31.099511 (+ 471us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:31.099572 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:31.099596 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:31.099683 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:31.099885 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 18:39:31.100166 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":146,"threads_started":1}
I20260808 18:39:31.102588 18409 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } }
I20260808 18:39:31.102805 18409 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:31.102885 18409 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ee8bbc7fa240e38fc1d3f022f5bf37, State: Initialized, Role: FOLLOWER
I20260808 18:39:31.103278 18409 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } }
I20260808 18:39:31.103406 18409 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:31.103475 18409 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:31.103570 18409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:31.104390 18409 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } }
I20260808 18:39:31.104700 18409 leader_election.cc:302] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1ee8bbc7fa240e38fc1d3f022f5bf37; no voters:
I20260808 18:39:31.104964 18409 leader_election.cc:288] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:31.105070 18418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:31.105274 18418 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [term 1 LEADER]: Becoming Leader. State: Replica: c1ee8bbc7fa240e38fc1d3f022f5bf37, State: Running, Role: LEADER
I20260808 18:39:31.105597 18418 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } }
I20260808 18:39:31.106101 18409 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:31.107111 18420 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1ee8bbc7fa240e38fc1d3f022f5bf37. Latest consensus state: current_term: 1 leader_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } } }
I20260808 18:39:31.107256 18420 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:31.107606 18429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:31.108021 18419 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ee8bbc7fa240e38fc1d3f022f5bf37" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35293 } } }
I20260808 18:39:31.108188 18419 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:31.110781 18429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:31.116081 18429 catalog_manager.cc:1347] Generated new cluster ID: 0d255e20310c4b92bea25de3d59a964f
I20260808 18:39:31.116147 18429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:31.129815 18429 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:31.130755 18429 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:31.135491 18429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1ee8bbc7fa240e38fc1d3f022f5bf37: Generated new TSK 0
I20260808 18:39:31.136128 18429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:39:31.143074 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--builtin_ntp_servers=127.4.61.212:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 18:39:31.257387 18443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:31.257686 18443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:31.257725 18443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:31.262105 18443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:31.262189 18443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:31.262246 18443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:31.267148 18443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:31.268312 18443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:31.269806 18443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:31.279204 18448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.279232 18450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.279361 18443 server_base.cc:1034] running on GCE node
W20260808 18:39:31.279536 18455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.279950 18443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:31.280551 18443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:31.281706 18443 hybrid_clock.cc:648] HybridClock initialized: now 1786214371281682 us; error 43 us; skew 500 ppm
I20260808 18:39:31.283427 18443 webserver.cc:460] Webserver started at http://127.4.61.193:33727/ using document root <none> and password file <none>
I20260808 18:39:31.283977 18443 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:31.284042 18443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:31.284240 18443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:31.286269 18443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "9a7c81fe910c491682d95d8a8c569125"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "23a60be07480e5c3a2a15958078d2556"
server_key_iv: "4b1d828235402b2dbb8d837d3548c872"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.286852 18443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "9a7c81fe910c491682d95d8a8c569125"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "23a60be07480e5c3a2a15958078d2556"
server_key_iv: "4b1d828235402b2dbb8d837d3548c872"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.290504 18443 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:39:31.293007 18466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.294265 18443 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:31.294426 18443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "9a7c81fe910c491682d95d8a8c569125"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "23a60be07480e5c3a2a15958078d2556"
server_key_iv: "4b1d828235402b2dbb8d837d3548c872"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.294535 18443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:31.305568 18443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:31.306226 18443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:31.306439 18443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:31.307045 18443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:31.308051 18443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:31.308101 18443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.308156 18443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:31.308183 18443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.318246 18443 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:35059
I20260808 18:39:31.318333 18650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:35059 every 8 connection(s)
I20260808 18:39:31.319543 18443 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:31.320448 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 18443
I20260808 18:39:31.320559 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:31.320842 4343 external_mini_cluster.cc:1428] Setting key 098c21ca5eaacfe9888b73722da70f7c
I20260808 18:39:31.322881 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--builtin_ntp_servers=127.4.61.212:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 18:39:31.329496 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.321635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:44925 (local address 127.4.61.254:35293)
0808 18:39:31.321756 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.321759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.323141 (+ 1382us) server_negotiation.cc:407] Connection header received
0808 18:39:31.324679 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.324682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.324733 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.324793 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.325939 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.326494 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.327684 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.327909 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.328005 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.329037 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:31.329040 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:31.329042 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:31.329054 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:31.329074 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:31.329082 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:31.329137 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:31.329280 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 18:39:31.329345 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:39:31.330374 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.322170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35293 (local address 127.4.61.193:44925)
0808 18:39:31.322999 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:31.323052 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:31.324429 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:31.324991 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:31.325000 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:31.325110 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:31.325812 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.325832 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.326615 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.326618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.327569 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.327579 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.328066 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.328070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.328228 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.328785 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:31.328787 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:31.328828 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:31.328893 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:31.329153 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:31.329162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:31.329167 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 18:39:31.329273 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 18:39:31.329568 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":142,"threads_started":1}
I20260808 18:39:31.331655 18651 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35293
I20260808 18:39:31.331885 18651 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:31.332428 18651 heartbeater.cc:511] Master 127.4.61.254:35293 requested a full tablet report, sending...
I20260808 18:39:31.333973 18353 ts_manager.cc:194] Registered new tserver with Master: 9a7c81fe910c491682d95d8a8c569125 (127.4.61.193:35059)
I20260808 18:39:31.335166 18353 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.193:44925
W20260808 18:39:31.435477 18657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:31.435752 18657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:31.435815 18657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:31.439847 18657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:31.439903 18657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:31.439976 18657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:31.444728 18657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:31.445771 18657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:31.447185 18657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:31.456368 18667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.456372 18664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.456364 18670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.456571 18657 server_base.cc:1034] running on GCE node
I20260808 18:39:31.457016 18657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:31.457592 18657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:31.458735 18657 hybrid_clock.cc:648] HybridClock initialized: now 1786214371458709 us; error 39 us; skew 500 ppm
I20260808 18:39:31.460502 18657 webserver.cc:460] Webserver started at http://127.4.61.194:46441/ using document root <none> and password file <none>
I20260808 18:39:31.461046 18657 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:31.461107 18657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:31.461303 18657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:31.463348 18657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "ce0e6b029b794f768cf345fe0c727659"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "dce9a0bc2d3fc0961ef0c1f0be6b6241"
server_key_iv: "728cd30a4ad97abf55097c966cf2bf30"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.463882 18657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "ce0e6b029b794f768cf345fe0c727659"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "dce9a0bc2d3fc0961ef0c1f0be6b6241"
server_key_iv: "728cd30a4ad97abf55097c966cf2bf30"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.467342 18657 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:39:31.469873 18678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.471102 18657 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:31.471197 18657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "ce0e6b029b794f768cf345fe0c727659"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "dce9a0bc2d3fc0961ef0c1f0be6b6241"
server_key_iv: "728cd30a4ad97abf55097c966cf2bf30"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.471303 18657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:31.491853 18657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:31.492534 18657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:31.492703 18657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:31.493288 18657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:31.494231 18657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:31.494278 18657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.494339 18657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:31.494371 18657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.502887 18657 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:42709
I20260808 18:39:31.502928 18842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:42709 every 8 connection(s)
I20260808 18:39:31.503755 18657 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:31.510269 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 18657
I20260808 18:39:31.510411 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:31.510753 4343 external_mini_cluster.cc:1428] Setting key f6c38a960715eabc34daebda9441486b
I20260808 18:39:31.512638 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--builtin_ntp_servers=127.4.61.212:39633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 18:39:31.513175 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.505562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:49909 (local address 127.4.61.254:35293)
0808 18:39:31.505710 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.505715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.506828 (+ 1113us) server_negotiation.cc:407] Connection header received
0808 18:39:31.508256 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.508259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.508355 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.508427 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.509247 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.509766 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.511289 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.511515 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.511599 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.512686 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:31.512690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:31.512692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:31.512706 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:31.512729 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:31.512739 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:31.512812 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:31.513010 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 18:39:31.513064 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 18:39:31.514182 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.506010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35293 (local address 127.4.61.194:49909)
0808 18:39:31.506690 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:31.506728 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:31.508062 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:31.508585 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:31.508592 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:31.508671 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:31.509137 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.509149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.509851 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.509854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.511168 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.511178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.511656 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.511660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.511857 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.512432 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:31.512434 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:31.512472 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:31.512532 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:31.512858 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:31.512868 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:31.512873 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 18:39:31.512990 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 18:39:31.513266 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
I20260808 18:39:31.515317 18844 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35293
I20260808 18:39:31.515542 18844 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:31.516047 18844 heartbeater.cc:511] Master 127.4.61.254:35293 requested a full tablet report, sending...
I20260808 18:39:31.517060 18353 ts_manager.cc:194] Registered new tserver with Master: ce0e6b029b794f768cf345fe0c727659 (127.4.61.194:42709)
I20260808 18:39:31.517664 18353 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.194:49909
W20260808 18:39:31.628736 18847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:31.629017 18847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:31.629069 18847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:31.633104 18847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:31.633167 18847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:31.633242 18847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:31.638206 18847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:31.639391 18847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:31.640808 18847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:31.650239 18856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.650219 18857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.650218 18860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.650305 18847 server_base.cc:1034] running on GCE node
I20260808 18:39:31.650882 18847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:31.651520 18847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:31.652678 18847 hybrid_clock.cc:648] HybridClock initialized: now 1786214371652657 us; error 33 us; skew 500 ppm
I20260808 18:39:31.654579 18847 webserver.cc:460] Webserver started at http://127.4.61.195:45679/ using document root <none> and password file <none>
I20260808 18:39:31.655151 18847 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:31.655215 18847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:31.655429 18847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:31.657568 18847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "b49e4a04f73b4d98bc8c5ea558cfa9e4"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "2726256a64bf1cf4c8a7bcc8bd1166f2"
server_key_iv: "ad92c4a93a75757ca7032a02022284e4"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.658154 18847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "b49e4a04f73b4d98bc8c5ea558cfa9e4"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "2726256a64bf1cf4c8a7bcc8bd1166f2"
server_key_iv: "ad92c4a93a75757ca7032a02022284e4"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.661912 18847 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:39:31.664448 18868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.665613 18847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:31.665714 18847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "b49e4a04f73b4d98bc8c5ea558cfa9e4"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "2726256a64bf1cf4c8a7bcc8bd1166f2"
server_key_iv: "ad92c4a93a75757ca7032a02022284e4"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.665832 18847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:31.679132 18847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:31.679859 18847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:31.680037 18847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:31.680648 18847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:31.681635 18847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:31.681684 18847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.681737 18847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:31.681767 18847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.690166 18847 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:34367
I20260808 18:39:31.690233 19031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:34367 every 8 connection(s)
I20260808 18:39:31.691144 18847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:31.700587 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 18847
I20260808 18:39:31.700714 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:31.700765 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.693072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:45495 (local address 127.4.61.254:35293)
0808 18:39:31.693214 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.693218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.694258 (+ 1040us) server_negotiation.cc:407] Connection header received
0808 18:39:31.695690 (+ 1432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.695694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.695763 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.695836 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.696824 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.697356 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.698603 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.698835 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.698947 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.700162 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:31.700165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:31.700170 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:31.700187 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:31.700208 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:31.700216 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:31.700324 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:31.700534 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 18:39:31.700603 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 18:39:31.701035 4343 external_mini_cluster.cc:1428] Setting key 0d0c0f404e9536dee28d96e2973b4cd8
I20260808 18:39:31.701745 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.693469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35293 (local address 127.4.61.195:45495)
0808 18:39:31.694109 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:31.694151 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:31.695484 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:31.696024 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:31.696031 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:31.696145 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:31.696676 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.696691 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.697480 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.697483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.698486 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:31.698497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:31.699048 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:31.699051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:31.699229 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:31.699828 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:31.699829 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:31.699876 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:31.699944 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:31.700338 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:31.700349 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:31.700355 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:39:31.700497 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 18:39:31.700827 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":110,"threads_started":1}
I20260808 18:39:31.702872 19032 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35293
I20260808 18:39:31.703117 19032 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:31.703722 19032 heartbeater.cc:511] Master 127.4.61.254:35293 requested a full tablet report, sending...
I20260808 18:39:31.704782 18353 ts_manager.cc:194] Registered new tserver with Master: b49e4a04f73b4d98bc8c5ea558cfa9e4 (127.4.61.195:34367)
I20260808 18:39:31.705348 18353 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.195:45495
I20260808 18:39:31.715286 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 18:39:31.718214 18415 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:31.717259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48900 (local address 127.4.61.254:35293)
0808 18:39:31.717397 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.717402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.717542 (+ 140us) server_negotiation.cc:407] Connection header received
0808 18:39:31.717668 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.717671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.717717 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.717781 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.718072 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48900: BlockingRecv error: recv got EOF from 127.0.0.1:48900 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:31.718453 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 18443
I20260808 18:39:31.732353 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 18657
I20260808 18:39:31.746169 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 18847
I20260808 18:39:31.757741 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 18303
2026-08-08T18:39:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (883 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T18:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:31Z Disabled control of system clock
I20260808 18:39:31.800733 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34687
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:44335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:34687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 18:39:31.912649 19053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:31.912921 19053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:31.912976 19053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:31.916939 19053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:31.916998 19053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:31.917013 19053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:31.917028 19053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:31.917042 19053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:31.921867 19053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:34687
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:34687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:31.923143 19053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:31.924623 19053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:31.933176 19061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:31.933171 19064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.933245 19053 server_base.cc:1034] running on GCE node
W20260808 18:39:31.933262 19062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:31.934027 19053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:31.935158 19053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:31.936327 19053 hybrid_clock.cc:648] HybridClock initialized: now 1786214371936314 us; error 33 us; skew 500 ppm
I20260808 18:39:31.938174 19053 webserver.cc:460] Webserver started at http://127.4.61.254:33337/ using document root <none> and password file <none>
I20260808 18:39:31.938769 19053 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:31.938832 19053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:31.939033 19053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:31.941049 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "3f8dfb08b5074bbfad0dca24b13c64a0"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "3f265531944350f4ecfd404fa3d48c92"
server_key_iv: "842226b2aaf9027657c27788a027a85f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.941619 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "3f8dfb08b5074bbfad0dca24b13c64a0"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "3f265531944350f4ecfd404fa3d48c92"
server_key_iv: "842226b2aaf9027657c27788a027a85f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.945259 19053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:39:31.947683 19074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:31.948930 19053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:31.949049 19053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "3f8dfb08b5074bbfad0dca24b13c64a0"
format_stamp: "Formatted at 2026-08-08 18:39:31 on dist-test-slave-fgb3"
server_key: "3f265531944350f4ecfd404fa3d48c92"
server_key_iv: "842226b2aaf9027657c27788a027a85f"
server_key_version: "encryptionkey@0"
I20260808 18:39:31.949158 19053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:31.953683 19053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:31.954268 19053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:31.954483 19053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:31.961311 19053 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:34687
I20260808 18:39:31.961329 19155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:34687 every 8 connection(s)
I20260808 18:39:31.962229 19053 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:31.965584 19156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:31.967248 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 19053
I20260808 18:39:31.967346 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:31.967613 4343 external_mini_cluster.cc:1428] Setting key 150c7f1bbe697adec6d76a6589fea6b8
I20260808 18:39:31.972100 19156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0: Bootstrap starting.
I20260808 18:39:31.973158 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:31.969070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51376 (local address 127.4.61.254:34687)
0808 18:39:31.969720 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:31.969735 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:31.969771 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:39:31.970473 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:31.970494 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:31.970844 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:31.971156 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:31.971926 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:31.971932 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:31.971944 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:31.971954 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:31.972011 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:31.972028 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:31.972155 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:31.972229 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 18:39:31.972478 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":136,"threads_started":1}
I20260808 18:39:31.974678 19156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:31.975508 19156 log.cc:824] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:31.977423 19156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0: No bootstrap required, opened a new log
I20260808 18:39:31.981074 19156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } }
I20260808 18:39:31.981312 19156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:31.981413 19156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8dfb08b5074bbfad0dca24b13c64a0, State: Initialized, Role: FOLLOWER
I20260808 18:39:31.981846 19156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } }
I20260808 18:39:31.981982 19156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:31.982054 19156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:31.982158 19156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:31.983191 19156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } }
I20260808 18:39:31.983529 19156 leader_election.cc:302] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f8dfb08b5074bbfad0dca24b13c64a0; no voters:
I20260808 18:39:31.983862 19156 leader_election.cc:288] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:31.983983 19165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:31.984195 19165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8dfb08b5074bbfad0dca24b13c64a0, State: Running, Role: LEADER
I20260808 18:39:31.984508 19165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } }
I20260808 18:39:31.985093 19156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:31.986052 19169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8dfb08b5074bbfad0dca24b13c64a0. Latest consensus state: current_term: 1 leader_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } } }
I20260808 18:39:31.986189 19169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:31.986142 19167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8dfb08b5074bbfad0dca24b13c64a0" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 34687 } } }
I20260808 18:39:31.986399 19167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:31.988122 19175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:31.991647 19175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:31.997059 19175 catalog_manager.cc:1347] Generated new cluster ID: fdc55d633e414c76bb239939ae90a60a
I20260808 18:39:31.997124 19175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:32.008080 19175 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:32.008359 19175 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:32.011693 19175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f8dfb08b5074bbfad0dca24b13c64a0: Generated new TSK 0
I20260808 18:39:32.012288 19175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:39:32.027635 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--builtin_ntp_servers=127.4.61.212:44335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 18:39:32.165096 19196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:32.165366 19196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:32.165408 19196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:32.169446 19196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:32.169505 19196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:32.169565 19196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:32.174329 19196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:32.175433 19196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:32.176834 19196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:32.186357 19207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:32.186347 19206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:32.186347 19209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:32.186856 19196 server_base.cc:1034] running on GCE node
I20260808 18:39:32.187247 19196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:32.187863 19196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:32.189023 19196 hybrid_clock.cc:648] HybridClock initialized: now 1786214372188978 us; error 63 us; skew 500 ppm
I20260808 18:39:32.190986 19196 webserver.cc:460] Webserver started at http://127.4.61.193:46437/ using document root <none> and password file <none>
I20260808 18:39:32.191545 19196 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:32.191613 19196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:32.191824 19196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:32.193882 19196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "3293dc6be64b461280c2872de0e05316"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "37994c592b030ef7add118f5564c6f3d"
server_key_iv: "f3aa02baf124a3cf93fa111416907011"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.194461 19196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "3293dc6be64b461280c2872de0e05316"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "37994c592b030ef7add118f5564c6f3d"
server_key_iv: "f3aa02baf124a3cf93fa111416907011"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.198019 19196 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:39:32.200667 19222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.201944 19196 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:32.202069 19196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "3293dc6be64b461280c2872de0e05316"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "37994c592b030ef7add118f5564c6f3d"
server_key_iv: "f3aa02baf124a3cf93fa111416907011"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.202174 19196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:32.206876 19196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:32.207472 19196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:32.207626 19196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:32.208156 19196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:32.209075 19196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:32.209123 19196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.209175 19196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:32.209201 19196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.217525 19196 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:45741
I20260808 18:39:32.217546 19401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:45741 every 8 connection(s)
I20260808 18:39:32.218478 19196 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:39:32.224524 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.220249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:40329 (local address 127.4.61.254:34687)
0808 18:39:32.220407 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:32.220410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:32.221466 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 18:39:32.222853 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:32.222857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:32.222908 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:32.222986 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:32.224046 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:32.224050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:32.224053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:32.224068 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:32.224088 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:32.224097 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:32.224176 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:32.224333 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 18:39:32.224383 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 18:39:32.225373 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.220629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34687 (local address 127.4.61.193:40329)
0808 18:39:32.221307 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:32.221355 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:32.222629 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:32.223169 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:32.223175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:32.223273 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:32.223781 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:32.223782 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:32.223823 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:32.223895 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:32.224166 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:32.224175 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:32.224181 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:39:32.224380 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 18:39:32.224625 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":123,"threads_started":1}
I20260808 18:39:32.225647 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 19196
I20260808 18:39:32.225773 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:32.226063 4343 external_mini_cluster.cc:1428] Setting key 1db36673012924dd87fb32df7c664517
I20260808 18:39:32.226613 19402 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34687
I20260808 18:39:32.226861 19402 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:32.227298 19402 heartbeater.cc:511] Master 127.4.61.254:34687 requested a full tablet report, sending...
I20260808 18:39:32.228017 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--builtin_ntp_servers=127.4.61.212:44335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 18:39:32.228889 19100 ts_manager.cc:194] Registered new tserver with Master: 3293dc6be64b461280c2872de0e05316 (127.4.61.193:45741)
W20260808 18:39:32.338871 19406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:32.339133 19406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:32.339188 19406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:32.343166 19406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:32.343216 19406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:32.343293 19406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:32.347944 19406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:32.348958 19406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:32.350356 19406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:32.359912 19413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:32.359980 19406 server_base.cc:1034] running on GCE node
W20260808 18:39:32.359921 19414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:32.359936 19416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:32.360605 19406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:32.361232 19406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:32.362390 19406 hybrid_clock.cc:648] HybridClock initialized: now 1786214372362369 us; error 28 us; skew 500 ppm
I20260808 18:39:32.364212 19406 webserver.cc:460] Webserver started at http://127.4.61.194:35375/ using document root <none> and password file <none>
I20260808 18:39:32.364758 19406 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:32.364816 19406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:32.364984 19406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:32.367065 19406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "e3d00021a9ed4ecd82b7da9615397756"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "20cbea07e33618a9f3cd139e1c99bd95"
server_key_iv: "059521a0f44948c2260d538a10091918"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.367596 19406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "e3d00021a9ed4ecd82b7da9615397756"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "20cbea07e33618a9f3cd139e1c99bd95"
server_key_iv: "059521a0f44948c2260d538a10091918"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.371397 19406 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 18:39:32.374033 19423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.375371 19406 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:39:32.375476 19406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "e3d00021a9ed4ecd82b7da9615397756"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "20cbea07e33618a9f3cd139e1c99bd95"
server_key_iv: "059521a0f44948c2260d538a10091918"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.375576 19406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:32.380071 19406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:32.380652 19406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:32.380788 19406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:32.381289 19406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:32.382220 19406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:32.382273 19406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.382341 19406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:32.382383 19406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.391083 19406 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:39785
I20260808 18:39:32.391139 19601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:39785 every 8 connection(s)
I20260808 18:39:32.391978 19406 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:32.394789 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 19406
I20260808 18:39:32.394910 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:39:32.395215 4343 external_mini_cluster.cc:1428] Setting key 0ae1c02dc91c3283d9e739b436b397bf
I20260808 18:39:32.397339 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--builtin_ntp_servers=127.4.61.212:44335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 18:39:32.398272 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.393789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:51137 (local address 127.4.61.254:34687)
0808 18:39:32.393916 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:32.393919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:32.395048 (+ 1129us) server_negotiation.cc:407] Connection header received
0808 18:39:32.396567 (+ 1519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:32.396570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:32.396606 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:32.396673 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:32.397812 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:32.397816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:32.397818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:32.397831 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:32.397854 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:32.397862 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:32.397935 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:32.398081 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 18:39:32.398125 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:39:32.399253 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.394174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34687 (local address 127.4.61.194:51137)
0808 18:39:32.394886 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:32.394939 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:32.396357 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:32.396846 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:32.396853 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:32.396940 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:32.397528 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:32.397530 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:32.397586 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:32.397670 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:32.397930 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:32.397938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:32.397945 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:39:32.398119 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 18:39:32.398390 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":141,"threads_started":1}
I20260808 18:39:32.400455 19602 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34687
I20260808 18:39:32.400683 19602 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:32.401126 19602 heartbeater.cc:511] Master 127.4.61.254:34687 requested a full tablet report, sending...
I20260808 18:39:32.402252 19100 ts_manager.cc:194] Registered new tserver with Master: e3d00021a9ed4ecd82b7da9615397756 (127.4.61.194:39785)
W20260808 18:39:32.512267 19607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:32.512531 19607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:32.512573 19607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:32.516606 19607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:32.516664 19607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:32.516719 19607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:32.521456 19607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:34687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:32.522524 19607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:32.523895 19607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:32.533380 19616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:32.533387 19623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:32.533386 19617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:32.533473 19607 server_base.cc:1034] running on GCE node
I20260808 18:39:32.533969 19607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:32.534596 19607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:32.535760 19607 hybrid_clock.cc:648] HybridClock initialized: now 1786214372535733 us; error 43 us; skew 500 ppm
I20260808 18:39:32.537515 19607 webserver.cc:460] Webserver started at http://127.4.61.195:35119/ using document root <none> and password file <none>
I20260808 18:39:32.538075 19607 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:32.538137 19607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:32.538383 19607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:32.540432 19607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "d1d1f579e9d348a9acfc5f0d109cb5da"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "3ff40dc0fe4a90cc4d5a27dfb3194ae8"
server_key_iv: "cffa1bc38d2b836769de9a4e96288813"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.540969 19607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "d1d1f579e9d348a9acfc5f0d109cb5da"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "3ff40dc0fe4a90cc4d5a27dfb3194ae8"
server_key_iv: "cffa1bc38d2b836769de9a4e96288813"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.544693 19607 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:39:32.547142 19632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.548424 19607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:39:32.548533 19607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "d1d1f579e9d348a9acfc5f0d109cb5da"
format_stamp: "Formatted at 2026-08-08 18:39:32 on dist-test-slave-fgb3"
server_key: "3ff40dc0fe4a90cc4d5a27dfb3194ae8"
server_key_iv: "cffa1bc38d2b836769de9a4e96288813"
server_key_version: "encryptionkey@0"
I20260808 18:39:32.548628 19607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:32.553428 19607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:32.554008 19607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:32.554147 19607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:32.554703 19607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:32.555608 19607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:32.555652 19607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.555689 19607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:32.555708 19607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:32.564291 19607 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:41639
I20260808 18:39:32.564345 19809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:41639 every 8 connection(s)
I20260808 18:39:32.565230 19607 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:32.566118 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 19607
I20260808 18:39:32.566213 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:32.566490 4343 external_mini_cluster.cc:1428] Setting key 15de27ead460bae667700df5993360c2
I20260808 18:39:32.572244 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.567922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:45285 (local address 127.4.61.254:34687)
0808 18:39:32.568049 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:32.568052 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:32.569280 (+ 1228us) server_negotiation.cc:407] Connection header received
0808 18:39:32.570660 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:32.570663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:32.570712 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:32.570797 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:32.571877 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:32.571880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:32.571882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:39:32.571896 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:32.571916 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:39:32.571924 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:32.571995 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:32.572085 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 18:39:32.572124 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:39:32.573096 19813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:32.568390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:34687 (local address 127.4.61.195:45285)
0808 18:39:32.569129 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:32.569183 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:32.570459 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:32.570946 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:32.570953 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:32.571042 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:32.571613 (+ 571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:39:32.571614 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:32.571657 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:39:32.571729 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:32.571988 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:32.571992 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:32.571996 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 18:39:32.572117 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 18:39:32.572313 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260808 18:39:32.574147 19810 heartbeater.cc:347] Connected to a master server at 127.4.61.254:34687
I20260808 18:39:32.574406 19810 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:32.574838 19810 heartbeater.cc:511] Master 127.4.61.254:34687 requested a full tablet report, sending...
I20260808 18:39:32.575865 19100 ts_manager.cc:194] Registered new tserver with Master: d1d1f579e9d348a9acfc5f0d109cb5da (127.4.61.195:41639)
I20260808 18:39:32.580509 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 18:39:32.583292 19163 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:39:32.582398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51388 (local address 127.4.61.254:34687)
0808 18:39:32.582524 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:32.582529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:32.582695 (+ 166us) server_negotiation.cc:407] Connection header received
0808 18:39:32.582823 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:32.582826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:32.582863 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:32.582944 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:32.583177 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51388: BlockingRecv error: recv got EOF from 127.0.0.1:51388 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:39:32.583540 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 19196
I20260808 18:39:32.598110 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 19406
I20260808 18:39:32.609689 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 19607
I20260808 18:39:32.620522 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 19053
2026-08-08T18:39:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (854 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:32 dist-test-slave-fgb3 krb5kdc[19823](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:32 dist-test-slave-fgb3 krb5kdc[19823](info): set up 2 sockets
Aug 08 18:39:32 dist-test-slave-fgb3 krb5kdc[19823](info): commencing operation
krb5kdc: starting...
W20260808 18:39:33.759573 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:33 dist-test-slave-fgb3 krb5kdc[19823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:39:33.884793 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37067
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:37067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:33.993837 19843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:33.994068 19843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:33.994105 19843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:33.998006 19843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:39:33.998061 19843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:33.998080 19843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:33.998093 19843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:39:33.998107 19843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:39:34.003307 19843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:37067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:34.004341 19843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:34.005324 19843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:34.013430 19851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.013438 19855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.013438 19853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:34.013767 19843 server_base.cc:1034] running on GCE node
I20260808 18:39:34.014351 19843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:34.015437 19843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:34.016635 19843 hybrid_clock.cc:648] HybridClock initialized: now 1786214374016619 us; error 29 us; skew 500 ppm
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:34.019609 19843 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:39:34.020563 19843 webserver.cc:460] Webserver started at http://127.4.61.254:33949/ using document root <none> and password file <none>
I20260808 18:39:34.021126 19843 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:34.021198 19843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:34.021430 19843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:34.023582 19843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "9c1fc9e6996b41f4b395527dd5068667"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "c90ba876474aaa97fcf3f40e68455a5c"
server_key_iv: "daca8c97bd09030e7b18b9f18faae0f8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.024142 19843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "9c1fc9e6996b41f4b395527dd5068667"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "c90ba876474aaa97fcf3f40e68455a5c"
server_key_iv: "daca8c97bd09030e7b18b9f18faae0f8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.028024 19843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 18:39:34.030566 19870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.031800 19843 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:39:34.031924 19843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "9c1fc9e6996b41f4b395527dd5068667"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "c90ba876474aaa97fcf3f40e68455a5c"
server_key_iv: "daca8c97bd09030e7b18b9f18faae0f8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.032028 19843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:34.042050 19843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:34.045284 19843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:34.045490 19843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:34.052618 19843 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:37067
I20260808 18:39:34.052863 19951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:37067 every 8 connection(s)
I20260808 18:39:34.053632 19843 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:39:34.056471 19952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:34.060935 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 19843
I20260808 18:39:34.061075 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:39:34.061362 4343 external_mini_cluster.cc:1428] Setting key e321825c6d6080bdd6d9de24426f7076
I20260808 18:39:34.062875 19952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: Bootstrap starting.
I20260808 18:39:34.065336 19952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:34.066118 19952 log.cc:824] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:34.068018 19952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: No bootstrap required, opened a new log
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:34.071738 19952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } }
I20260808 18:39:34.071985 19952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:34.072045 19952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c1fc9e6996b41f4b395527dd5068667, State: Initialized, Role: FOLLOWER
I20260808 18:39:34.072511 19952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } }
I20260808 18:39:34.072652 19952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:39:34.072721 19952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:39:34.072822 19952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:34.073828 19952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } }
I20260808 18:39:34.074219 19952 leader_election.cc:302] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c1fc9e6996b41f4b395527dd5068667; no voters:
I20260808 18:39:34.074576 19952 leader_election.cc:288] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:39:34.074684 19964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:34.074910 19964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [term 1 LEADER]: Becoming Leader. State: Replica: 9c1fc9e6996b41f4b395527dd5068667, State: Running, Role: LEADER
I20260808 18:39:34.075281 19964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } }
I20260808 18:39:34.075392 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.062879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.4.61.254:37067)
0808 18:39:34.063322 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.063338 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.063375 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:39:34.064040 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.064057 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.064395 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.064676 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:34.065608 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.066691 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.067549 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.068029 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.068175 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.070582 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:34.070588 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:34.070602 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:34.070631 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:34.072269 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.072682 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.072688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.072693 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.072837 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.073151 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.073153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.073154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.073553 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:34.073703 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.074042 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.074366 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":129,"threads_started":1}
I20260808 18:39:34.075841 19952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:39:34.076474 19966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c1fc9e6996b41f4b395527dd5068667. Latest consensus state: current_term: 1 leader_uuid: "9c1fc9e6996b41f4b395527dd5068667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } } }
I20260808 18:39:34.076594 19966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [sys.catalog]: This master's current role is: LEADER
I20260808 18:39:34.076917 19965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c1fc9e6996b41f4b395527dd5068667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1fc9e6996b41f4b395527dd5068667" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37067 } } }
I20260808 18:39:34.077006 19965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667 [sys.catalog]: This master's current role is: LEADER
W20260808 18:39:34.080559 19991 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:39:34.080646 19991 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:39:34.080701 19977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:39:34.081377 19977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:39:34.086719 19977 catalog_manager.cc:1347] Generated new cluster ID: ec2390e8cc4c423098548b35f8a2694b
I20260808 18:39:34.086807 19977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:39:34.102228 19977 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:39:34.103255 19977 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:39:34.108472 19977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: Generated new TSK 0
I20260808 18:39:34.109313 19977 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:39:34.137521 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:34.254259 20000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:34.254541 20000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:34.254585 20000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:34.258507 20000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:34.258564 20000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:34.258621 20000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:39:34.264195 20000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:34.265249 20000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:34.266235 20000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:34.275874 20011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.275889 20005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:34.275954 20000 server_base.cc:1034] running on GCE node
W20260808 18:39:34.275892 20007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:34.276522 20000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:34.277280 20000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:34.278436 20000 hybrid_clock.cc:648] HybridClock initialized: now 1786214374278418 us; error 34 us; skew 500 ppm
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:34.281142 20000 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:39:34.282022 20000 webserver.cc:460] Webserver started at http://127.4.61.193:33735/ using document root <none> and password file <none>
I20260808 18:39:34.282639 20000 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:34.282702 20000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:34.282874 20000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:34.284937 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "e269db40a5004d6c927a60148c34b9f8"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "64da4671d44e3b7561d4c7bf4e98ec82"
server_key_iv: "ca420faae8b37c6c9f2351b24f412842"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.285557 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "e269db40a5004d6c927a60148c34b9f8"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "64da4671d44e3b7561d4c7bf4e98ec82"
server_key_iv: "ca420faae8b37c6c9f2351b24f412842"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.289258 20000 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 18:39:34.291742 20026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.293020 20000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:39:34.293133 20000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "e269db40a5004d6c927a60148c34b9f8"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "64da4671d44e3b7561d4c7bf4e98ec82"
server_key_iv: "ca420faae8b37c6c9f2351b24f412842"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.293226 20000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:34.321204 20000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:34.324084 20000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:34.324239 20000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:34.324786 20000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:34.325577 20000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:34.325623 20000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.325662 20000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:34.325681 20000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.333858 20000 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:46593
I20260808 18:39:34.333894 20207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:46593 every 8 connection(s)
I20260808 18:39:34.334771 20000 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:34.345000 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 20000
I20260808 18:39:34.345124 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:39:34.345463 4343 external_mini_cluster.cc:1428] Setting key 4ef06c5bfe64115f4bfeed9564b2c6a8
I20260808 18:39:34.348090 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.336558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:39527 (local address 127.4.61.254:37067)
0808 18:39:34.336691 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.336695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.337509 (+ 814us) server_negotiation.cc:407] Connection header received
0808 18:39:34.338933 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.338937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.338994 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.339069 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:34.340229 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.340782 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.341890 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.342127 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.342218 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.344574 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:34.344577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:34.344579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:34.344605 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:34.346021 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.346571 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.346574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.346576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.346663 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.347014 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.347018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.347019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.347199 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:34.347285 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.347791 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.347930 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:34.348842 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.336951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37067 (local address 127.4.61.193:39527)
0808 18:39:34.337371 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.337412 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.338729 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.339257 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.339264 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.339609 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:34.340084 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.340097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.340907 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.340910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.341772 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.341781 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.342266 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.342270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.342465 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.342983 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:34.342999 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:34.344408 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:34.346137 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.346143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.346157 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.346483 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.346746 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.346749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.346751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.346914 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.347298 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:34.347304 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:34.347558 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.347716 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.348028 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":107,"threads_started":1}
I20260808 18:39:34.349937 20208 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37067
I20260808 18:39:34.350159 20208 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:34.350656 20208 heartbeater.cc:511] Master 127.4.61.254:37067 requested a full tablet report, sending...
I20260808 18:39:34.352047 19897 ts_manager.cc:194] Registered new tserver with Master: e269db40a5004d6c927a60148c34b9f8 (127.4.61.193:46593)
I20260808 18:39:34.353132 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:39527
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:39:34.372632 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:34.483785 20220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:34.484114 20220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:34.484177 20220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:34.488196 20220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:34.488247 20220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:34.488309 20220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:39:34.493536 20220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:34.494521 20220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:34.495496 20220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:39:34.505084 20220 server_base.cc:1034] running on GCE node
W20260808 18:39:34.505035 20228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.505035 20226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.505035 20231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:34.505713 20220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:34.506371 20220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:34.507532 20220 hybrid_clock.cc:648] HybridClock initialized: now 1786214374507512 us; error 32 us; skew 500 ppm
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:34.510126 20220 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:39:34.511003 20220 webserver.cc:460] Webserver started at http://127.4.61.194:41641/ using document root <none> and password file <none>
I20260808 18:39:34.511518 20220 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:34.511574 20220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:34.511749 20220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:34.513672 20220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "ade62182d25948a79a8b264b1c8c37df"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "63084f43e7418c164682956fc9e76c25"
server_key_iv: "e838d0dff35647da15598a65fc4355c8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.514189 20220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "ade62182d25948a79a8b264b1c8c37df"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "63084f43e7418c164682956fc9e76c25"
server_key_iv: "e838d0dff35647da15598a65fc4355c8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.517664 20220 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 18:39:34.520591 20242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.522007 20220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 18:39:34.522112 20220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "ade62182d25948a79a8b264b1c8c37df"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "63084f43e7418c164682956fc9e76c25"
server_key_iv: "e838d0dff35647da15598a65fc4355c8"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.522204 20220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:34.551757 20220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:34.558228 20220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:34.558461 20220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:34.559093 20220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:34.559965 20220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:34.560014 20220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.560068 20220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:34.560097 20220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.568781 20220 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:42715
I20260808 18:39:34.568819 20437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:42715 every 8 connection(s)
I20260808 18:39:34.569696 20220 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:39:34.579316 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 20220
I20260808 18:39:34.579425 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:34.579720 4343 external_mini_cluster.cc:1428] Setting key 49226569cd6ba63c6ca8bf45e3cd460f
I20260808 18:39:34.583768 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.571576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:36519 (local address 127.4.61.254:37067)
0808 18:39:34.571722 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.571726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.572544 (+ 818us) server_negotiation.cc:407] Connection header received
0808 18:39:34.573946 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.573950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.574010 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.574086 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:34.575498 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.576039 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.577321 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.577618 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.577703 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.580187 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:34.580191 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:34.580194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:34.580223 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:34.581602 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.582157 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.582159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.582161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.582229 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.582592 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.582594 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.582595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.582768 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:34.582841 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.583487 (+ 646us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.583610 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 18:39:34.584525 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.571917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37067 (local address 127.4.61.194:36519)
0808 18:39:34.572389 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.572434 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.573726 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.574297 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.574307 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.574824 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:34.575341 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.575377 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.576140 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.576150 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.577202 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.577213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.577755 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.577759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.577906 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.578533 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:34.578550 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:34.580024 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:34.581725 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.581731 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.581748 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.582068 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.582297 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.582300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.582302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.582510 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.582857 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:34.582863 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:34.583166 (+ 303us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.583386 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.583666 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260808 18:39:34.585645 20439 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37067
I20260808 18:39:34.585916 20439 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:34.586565 20439 heartbeater.cc:511] Master 127.4.61.254:37067 requested a full tablet report, sending...
I20260808 18:39:34.587672 19897 ts_manager.cc:194] Registered new tserver with Master: ade62182d25948a79a8b264b1c8c37df (127.4.61.194:42715)
I20260808 18:39:34.588222 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:36519
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:39:34.609721 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:39:34.724119 20446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:39:34.724404 20446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:39:34.724450 20446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:39:34.728605 20446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:39:34.728669 20446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:39:34.728742 20446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:39:34.734083 20446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:39:34.735195 20446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:39:34.736266 20446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:39:34.745579 20454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.745661 20453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:39:34.745582 20456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:39:34.745759 20446 server_base.cc:1034] running on GCE node
I20260808 18:39:34.746219 20446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:39:34.746904 20446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:39:34.748070 20446 hybrid_clock.cc:648] HybridClock initialized: now 1786214374748046 us; error 36 us; skew 500 ppm
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:39:34.750699 20446 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:39:34.751524 20446 webserver.cc:460] Webserver started at http://127.4.61.195:37885/ using document root <none> and password file <none>
I20260808 18:39:34.752128 20446 fs_manager.cc:359] Metadata directory not provided
I20260808 18:39:34.752202 20446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:39:34.752427 20446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:39:34.754390 20446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "b802e0c8bd7e4550825b43a091b32efa"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "dbc9464bbc36373bc5d73758cb192f73"
server_key_iv: "78e3268a2d04903a107d30061c6690f9"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.754997 20446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "b802e0c8bd7e4550825b43a091b32efa"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "dbc9464bbc36373bc5d73758cb192f73"
server_key_iv: "78e3268a2d04903a107d30061c6690f9"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.758533 20446 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:39:34.760888 20464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.762075 20446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:39:34.762190 20446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "b802e0c8bd7e4550825b43a091b32efa"
format_stamp: "Formatted at 2026-08-08 18:39:34 on dist-test-slave-fgb3"
server_key: "dbc9464bbc36373bc5d73758cb192f73"
server_key_iv: "78e3268a2d04903a107d30061c6690f9"
server_key_version: "encryptionkey@0"
I20260808 18:39:34.762332 20446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:39:34.772598 20446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:39:34.775444 20446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:39:34.775596 20446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:39:34.776158 20446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:39:34.776981 20446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:39:34.777032 20446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.777076 20446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:39:34.777096 20446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:39:34.785346 20446 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:46377
I20260808 18:39:34.785375 20658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:46377 every 8 connection(s)
I20260808 18:39:34.786186 20446 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:39:34.786439 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 20446
I20260808 18:39:34.786559 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:39:34.786931 4343 external_mini_cluster.cc:1428] Setting key f1e36c61961c1d11effd1d72e1330559
Aug 08 18:39:34 dist-test-slave-fgb3 krb5kdc[19823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:39:34.799855 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.788289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:59811 (local address 127.4.61.254:37067)
0808 18:39:34.788431 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.788436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.789394 (+ 958us) server_negotiation.cc:407] Connection header received
0808 18:39:34.790786 (+ 1392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.790789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.790834 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.790898 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:34.792046 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.792573 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.793679 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.793964 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.794041 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.796492 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:34.796495 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:34.796497 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:34.796523 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:34.797927 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.798477 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.798480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.798481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.798562 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.798852 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.798854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.798855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.799025 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:34.799096 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.799582 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.799699 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:39:34.800735 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.788787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37067 (local address 127.4.61.195:59811)
0808 18:39:34.789239 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.789302 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.790611 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.791031 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.791037 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.791390 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:39:34.791923 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.791938 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.792681 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.792683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.793569 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.793579 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.794101 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.794104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.794251 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.794833 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:39:34.794850 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:39:34.796323 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:39:34.798059 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.798068 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.798079 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.798393 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.798634 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:39:34.798636 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:39:34.798637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:39:34.798766 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:39:34.799097 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:39:34.799101 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:39:34.799355 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.799501 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.799807 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":115,"threads_started":1}
I20260808 18:39:34.801880 20659 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37067
I20260808 18:39:34.802119 20659 heartbeater.cc:464] Registering TS with master...
I20260808 18:39:34.802642 20659 heartbeater.cc:511] Master 127.4.61.254:37067 requested a full tablet report, sending...
I20260808 18:39:34.803707 19897 ts_manager.cc:194] Registered new tserver with Master: b802e0c8bd7e4550825b43a091b32efa (127.4.61.195:46377)
I20260808 18:39:34.804260 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:59811
I20260808 18:39:34.812832 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:39:34.821836 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.814666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.4.61.254:37067)
0808 18:39:34.814782 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.814785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.814980 (+ 195us) server_negotiation.cc:407] Connection header received
0808 18:39:34.815084 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.815086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.815123 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.815186 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:39:34.815888 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.816387 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.817311 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.817528 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.817609 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.818904 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:39:34.818907 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:39:34.818909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:39:34.818930 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:39:34.820070 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.820558 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.820562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.820564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.820652 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:39:34.820929 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:39:34.820933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:39:34.820935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:39:34.821168 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:39:34.821308 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.821554 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.821671 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:39:34.824507 19897 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:39:34.827486 19897 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:39:34.842011 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46593 (local address 127.0.0.1:58350)
0808 18:39:34.836566 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.836617 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.836741 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.837509 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.837516 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.837538 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:34.837693 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.837701 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.839190 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.839193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.840513 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.840525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.841391 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.841395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.841561 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.841610 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.841717 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.841854 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":39,"thread_start_us":85,"threads_started":1}
I20260808 18:39:34.842393 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52296 (local address 127.4.61.194:42715)
0808 18:39:34.837505 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.837516 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.837533 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:39:34.837595 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.837599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.837745 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.837896 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:34.838410 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.839419 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.840749 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.841557 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.841656 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.841791 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.842116 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.842220 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":108,"threads_started":1}
I20260808 18:39:34.842041 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42715 (local address 127.0.0.1:52296)
0808 18:39:34.837099 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.837111 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.837187 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.838077 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.838080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.838112 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:34.838267 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.838274 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.839535 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.839539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.840636 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.840645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.841668 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.841672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.841798 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.841822 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.841884 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.841944 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":47,"spinlock_wait_cycles":10112,"thread_start_us":95,"threads_started":1}
I20260808 18:39:34.842662 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58350 (local address 127.4.61.193:46593)
0808 18:39:34.837006 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.837025 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.837047 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:39:34.837126 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.837132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.837334 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.837847 (+ 513us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:34.838016 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.839062 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.840660 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.841244 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.841378 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.841544 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.842420 (+ 876us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.842523 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":111,"threads_started":1}
I20260808 18:39:34.843394 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:46377 (local address 127.0.0.1:45874)
0808 18:39:34.837066 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.837081 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.837171 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.838077 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.838080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.838106 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:34.838274 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.838280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.840605 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.840609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.841805 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.841816 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.842974 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.842978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.843067 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.843091 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.843182 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.843251 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":64,"spinlock_wait_cycles":2048,"thread_start_us":120,"threads_started":1}
I20260808 18:39:34.843796 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.836367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45874 (local address 127.4.61.195:46377)
0808 18:39:34.837453 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.837464 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.837486 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:39:34.837564 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.837569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.837745 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.837896 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:34.839550 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.840463 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.841913 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.842667 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.842772 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.842907 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.843566 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.843665 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":115,"threads_started":1}
I20260808 18:39:34.845530 20322 tablet_service.cc:1467] Processing CreateTablet for tablet a9e88f977d66423ba662e96737e41c64 (DEFAULT_TABLE table=test-table [id=9a6d8667d7a948a68cd7f6a5dd44159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:34.845696 20098 tablet_service.cc:1467] Processing CreateTablet for tablet a9e88f977d66423ba662e96737e41c64 (DEFAULT_TABLE table=test-table [id=9a6d8667d7a948a68cd7f6a5dd44159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:34.846516 20322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e88f977d66423ba662e96737e41c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:34.846213 20545 tablet_service.cc:1467] Processing CreateTablet for tablet a9e88f977d66423ba662e96737e41c64 (DEFAULT_TABLE table=test-table [id=9a6d8667d7a948a68cd7f6a5dd44159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:39:34.846869 20098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e88f977d66423ba662e96737e41c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:34.847215 20545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9e88f977d66423ba662e96737e41c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:39:34.852715 20685 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Bootstrap starting.
I20260808 18:39:34.854010 20687 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: Bootstrap starting.
I20260808 18:39:34.854422 20688 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Bootstrap starting.
I20260808 18:39:34.855875 20685 tablet_bootstrap.cc:654] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:34.856468 20688 tablet_bootstrap.cc:654] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:34.856758 20685 log.cc:824] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:34.857681 20688 log.cc:824] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:34.858827 20685 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: No bootstrap required, opened a new log
I20260808 18:39:34.859015 20685 ts_tablet_manager.cc:1397] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:39:34.859275 20687 tablet_bootstrap.cc:654] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: Neither blocks nor log segments found. Creating new log.
I20260808 18:39:34.859735 20688 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: No bootstrap required, opened a new log
I20260808 18:39:34.859935 20688 ts_tablet_manager.cc:1397] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:39:34.860059 20687 log.cc:824] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: Log is configured to *not* fsync() on all Append() calls
I20260808 18:39:34.861918 20687 tablet_bootstrap.cc:492] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: No bootstrap required, opened a new log
I20260808 18:39:34.862095 20687 ts_tablet_manager.cc:1397] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 18:39:34.862083 20685 raft_consensus.cc:348] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.862347 20685 raft_consensus.cc:374] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:34.862425 20685 raft_consensus.cc:729] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade62182d25948a79a8b264b1c8c37df, State: Initialized, Role: FOLLOWER
I20260808 18:39:34.862875 20685 consensus_queue.cc:260] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.863487 20688 raft_consensus.cc:348] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.863765 20688 raft_consensus.cc:374] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:34.863829 20688 raft_consensus.cc:729] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b802e0c8bd7e4550825b43a091b32efa, State: Initialized, Role: FOLLOWER
I20260808 18:39:34.863922 20685 ts_tablet_manager.cc:1428] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:39:34.864317 20688 consensus_queue.cc:260] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.864414 20439 heartbeater.cc:503] Master 127.4.61.254:37067 was elected leader, sending a full tablet report...
I20260808 18:39:34.865010 20659 heartbeater.cc:503] Master 127.4.61.254:37067 was elected leader, sending a full tablet report...
I20260808 18:39:34.866209 20688 ts_tablet_manager.cc:1428] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:39:34.866277 20687 raft_consensus.cc:348] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.866544 20687 raft_consensus.cc:374] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:39:34.866602 20687 raft_consensus.cc:729] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e269db40a5004d6c927a60148c34b9f8, State: Initialized, Role: FOLLOWER
I20260808 18:39:34.866966 20687 consensus_queue.cc:260] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.867506 20208 heartbeater.cc:503] Master 127.4.61.254:37067 was elected leader, sending a full tablet report...
I20260808 18:39:34.867821 20687 ts_tablet_manager.cc:1428] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:39:34.970503 20695 raft_consensus.cc:482] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:39:34.970763 20695 raft_consensus.cc:504] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.972124 20695 leader_election.cc:288] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e269db40a5004d6c927a60148c34b9f8 (127.4.61.193:46593), b802e0c8bd7e4550825b43a091b32efa (127.4.61.195:46377)
I20260808 18:39:34.975814 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.972567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:44593 (local address 127.4.61.195:46377)
0808 18:39:34.972692 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.972697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.972716 (+ 19us) server_negotiation.cc:407] Connection header received
0808 18:39:34.972859 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.972862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.972912 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.972987 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:34.973287 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.973779 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.974867 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.975275 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.975388 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.975448 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.975623 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.975694 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:39:34.975816 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.972479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:46377 (local address 127.4.61.194:44593)
0808 18:39:34.972606 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.972623 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.972735 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.973020 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.973022 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.973042 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:34.973164 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.973170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.973889 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.973892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.974735 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.974745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.975405 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.975409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.975512 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.975530 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.975596 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.975665 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 18:39:34.976544 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.972481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46593 (local address 127.4.61.194:43859)
0808 18:39:34.973186 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:34.973199 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:39:34.973306 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:39:34.973560 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:39:34.973563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:39:34.973580 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:39:34.973711 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.973718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.974511 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.974515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.975300 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:39:34.975310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.976071 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.976075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:39:34.976173 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.976198 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:39:34.976329 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 18:39:34.976402 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"mutex_wait_us":335,"thread_start_us":131,"threads_started":1}
I20260808 18:39:34.976581 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:34.972647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:43859 (local address 127.4.61.193:46593)
0808 18:39:34.972808 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:34.972812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:34.973292 (+ 480us) server_negotiation.cc:407] Connection header received
0808 18:39:34.973418 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:34.973420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:34.973468 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:34.973540 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:39:34.973829 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.974407 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.975463 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:34.975869 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:34.975999 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:34.976053 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:34.976383 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 18:39:34.976479 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 18:39:34.976578 20572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e88f977d66423ba662e96737e41c64" candidate_uuid: "ade62182d25948a79a8b264b1c8c37df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b802e0c8bd7e4550825b43a091b32efa" is_pre_election: true
I20260808 18:39:34.976992 20572 raft_consensus.cc:2454] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade62182d25948a79a8b264b1c8c37df in term 0.
I20260808 18:39:34.977258 20125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e88f977d66423ba662e96737e41c64" candidate_uuid: "ade62182d25948a79a8b264b1c8c37df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e269db40a5004d6c927a60148c34b9f8" is_pre_election: true
I20260808 18:39:34.977547 20245 leader_election.cc:302] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade62182d25948a79a8b264b1c8c37df, b802e0c8bd7e4550825b43a091b32efa; no voters:
I20260808 18:39:34.977596 20125 raft_consensus.cc:2454] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade62182d25948a79a8b264b1c8c37df in term 0.
I20260808 18:39:34.977829 20695 raft_consensus.cc:2781] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:39:34.977936 20695 raft_consensus.cc:482] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:39:34.978009 20695 raft_consensus.cc:3037] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:34.979151 20695 raft_consensus.cc:504] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.979509 20695 leader_election.cc:288] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [CANDIDATE]: Term 1 election: Requested vote from peers e269db40a5004d6c927a60148c34b9f8 (127.4.61.193:46593), b802e0c8bd7e4550825b43a091b32efa (127.4.61.195:46377)
I20260808 18:39:34.979854 20125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e88f977d66423ba662e96737e41c64" candidate_uuid: "ade62182d25948a79a8b264b1c8c37df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e269db40a5004d6c927a60148c34b9f8"
I20260808 18:39:34.979929 20572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9e88f977d66423ba662e96737e41c64" candidate_uuid: "ade62182d25948a79a8b264b1c8c37df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b802e0c8bd7e4550825b43a091b32efa"
I20260808 18:39:34.979972 20125 raft_consensus.cc:3037] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:34.980057 20572 raft_consensus.cc:3037] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:39:34.981081 20125 raft_consensus.cc:2454] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade62182d25948a79a8b264b1c8c37df in term 1.
I20260808 18:39:34.981101 20572 raft_consensus.cc:2454] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade62182d25948a79a8b264b1c8c37df in term 1.
I20260808 18:39:34.981349 20248 leader_election.cc:302] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade62182d25948a79a8b264b1c8c37df, e269db40a5004d6c927a60148c34b9f8; no voters:
I20260808 18:39:34.981514 20695 raft_consensus.cc:2781] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:39:34.981735 20695 raft_consensus.cc:686] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 1 LEADER]: Becoming Leader. State: Replica: ade62182d25948a79a8b264b1c8c37df, State: Running, Role: LEADER
I20260808 18:39:34.982048 20695 consensus_queue.cc:237] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } }
I20260808 18:39:34.985407 19895 catalog_manager.cc:5495] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df reported cstate change: term changed from 0 to 1, leader changed from <none> to ade62182d25948a79a8b264b1c8c37df (127.4.61.194). New cstate: current_term: 1 leader_uuid: "ade62182d25948a79a8b264b1c8c37df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade62182d25948a79a8b264b1c8c37df" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42715 } health_report { overall_health: HEALTHY } } }
I20260808 18:39:35.030709 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:35.027011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52304 (local address 127.4.61.194:42715)
0808 18:39:35.027163 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 18:39:35.027167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:39:35.027218 (+ 51us) server_negotiation.cc:407] Connection header received
0808 18:39:35.027415 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:39:35.027418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:39:35.027478 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:39:35.027574 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:39:35.027842 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:35.028367 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:35.029208 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:39:35.029432 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:39:35.029521 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:39:35.029848 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:39:35.030293 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:39:35.030424 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 18:39:35.030515 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 18:39:35.030570 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 18:39:35.036415 20572 raft_consensus.cc:1261] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 1 FOLLOWER]: Refusing update from remote peer ade62182d25948a79a8b264b1c8c37df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:35.036415 20125 raft_consensus.cc:1261] T a9e88f977d66423ba662e96737e41c64 P e269db40a5004d6c927a60148c34b9f8 [term 1 FOLLOWER]: Refusing update from remote peer ade62182d25948a79a8b264b1c8c37df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:39:35.037129 20695 consensus_queue.cc:1035] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e269db40a5004d6c927a60148c34b9f8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 18:39:35.037328 20660 tablet.cc:2369] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:39:35.037379 20701 consensus_queue.cc:1035] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b802e0c8bd7e4550825b43a091b32efa" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 46377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:39:35.043931 20704 mvcc.cc:205] Tried to move back new op lower bound from 7316334080141910016 to 7316334079929188352. Current Snapshot: MvccSnapshot[applied={T|T < 7316334080141910016}]
I20260808 18:39:35.047308 20708 mvcc.cc:205] Tried to move back new op lower bound from 7316334080141910016 to 7316334079929188352. Current Snapshot: MvccSnapshot[applied={T|T < 7316334080141910016 or (T in {7316334080141910016})}]
I20260808 18:39:35.047451 20706 mvcc.cc:205] Tried to move back new op lower bound from 7316334080141910016 to 7316334079929188352. Current Snapshot: MvccSnapshot[applied={T|T < 7316334080141910016}]
I20260808 18:39:35.052842 19893 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:35.052990 19893 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:39:35.055114 19893 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c1fc9e6996b41f4b395527dd5068667: Sending DeleteTablet for 3 replicas of tablet a9e88f977d66423ba662e96737e41c64
I20260808 18:39:35.055775 20098 tablet_service.cc:1514] Processing DeleteTablet for tablet a9e88f977d66423ba662e96737e41c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:35 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:58350
I20260808 18:39:35.055820 20545 tablet_service.cc:1514] Processing DeleteTablet for tablet a9e88f977d66423ba662e96737e41c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:35 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45874
I20260808 18:39:35.056166 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 20000
I20260808 18:39:35.056247 20322 tablet_service.cc:1514] Processing DeleteTablet for tablet a9e88f977d66423ba662e96737e41c64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:39:35 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:52296
I20260808 18:39:35.061805 20722 tablet_replica.cc:330] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: stopping tablet replica
I20260808 18:39:35.062098 20722 raft_consensus.cc:2229] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:39:35.062558 20722 raft_consensus.cc:2258] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:35.064509 20722 ts_tablet_manager.cc:1905] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:39:35.067683 20722 ts_tablet_manager.cc:1918] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:35.067785 20722 log.cc:1196] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/a9e88f977d66423ba662e96737e41c64
I20260808 18:39:35.068125 20722 ts_tablet_manager.cc:1939] T a9e88f977d66423ba662e96737e41c64 P ade62182d25948a79a8b264b1c8c37df: Deleting consensus metadata
I20260808 18:39:35.069368 19874 catalog_manager.cc:4841] TS ade62182d25948a79a8b264b1c8c37df (127.4.61.194:42715): tablet a9e88f977d66423ba662e96737e41c64 (table test-table [id=9a6d8667d7a948a68cd7f6a5dd44159d]) successfully deleted
I20260808 18:39:35.074554 20717 tablet_replica.cc:330] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: stopping tablet replica
I20260808 18:39:35.074910 20717 raft_consensus.cc:2229] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:39:35.075282 20717 raft_consensus.cc:2258] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:39:35.076876 20717 ts_tablet_manager.cc:1905] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 18:39:35.078823 19875 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:46593 (error 108)
I20260808 18:39:35.079425 20717 ts_tablet_manager.cc:1918] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:39:35.079566 20717 log.cc:1196] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/a9e88f977d66423ba662e96737e41c64
I20260808 18:39:35.079849 20717 ts_tablet_manager.cc:1939] T a9e88f977d66423ba662e96737e41c64 P b802e0c8bd7e4550825b43a091b32efa: Deleting consensus metadata
I20260808 18:39:35.079959 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:39:35.079615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46593 (local address 127.0.0.1:58354)
0808 18:39:35.079808 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 18:39:35.079874 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260808 18:39:35.080120 19875 catalog_manager.cc:4584] TS e269db40a5004d6c927a60148c34b9f8 (127.4.61.193:46593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a9e88f977d66423ba662e96737e41c64: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46593: connect: Connection refused (error 111)
I20260808 18:39:35.080557 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 20220
I20260808 18:39:35.096204 19873 catalog_manager.cc:4841] TS b802e0c8bd7e4550825b43a091b32efa (127.4.61.195:46377): tablet a9e88f977d66423ba662e96737e41c64 (table test-table [id=9a6d8667d7a948a68cd7f6a5dd44159d]) successfully deleted
I20260808 18:39:35.115836 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 20446
I20260808 18:39:35.126910 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 19843
2026-08-08T18:39:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2507 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:39:35 dist-test-slave-fgb3 krb5kdc[20728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:39:35 dist-test-slave-fgb3 krb5kdc[20728](info): set up 2 sockets
Aug 08 18:39:35 dist-test-slave-fgb3 krb5kdc[20728](info): commencing operation
krb5kdc: starting...
W20260808 18:39:36.274940 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:39:36 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:39:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:39:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangeradmin_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangeradmin_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangerlookup_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangerlookup_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
I20260808 18:39:36.448539 4343 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklYnvF7/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/postgres -l logfile start
2026-08-08 18:39:38.894 UTC [20784] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 18:39:38.894 UTC [20784] LOG: listening on IPv4 address "127.4.61.212", port 34851
2026-08-08 18:39:38.898 UTC [20784] LOG: listening on Unix socket "/tmp/.s.PGSQL.34851"
2026-08-08 18:39:38.919 UTC [20787] LOG: database system was shut down at 2026-08-08 18:39:37 UTC
2026-08-08 18:39:38.923 UTC [20784] LOG: database system is ready to accept connections
I20260808 18:39:39.971282 4343 mini_postgres.cc:96] Postgres bound to 34851
2026-08-08 18:39:39.979 UTC [20798] FATAL: database "slave" does not exist
127.4.61.212:34851 - accepting connections
I20260808 18:39:39.980515 4343 mini_ranger.cc:161] Starting Ranger...
I20260808 18:39:39.996261 4343 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 18:39:40.487835 4343 mini_ranger.cc:87] Created ranger Postgres database
I20260808 18:39:40.487928 4343 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin
2026-08-08 18:39:40,814 [I] DB FLAVOR :POSTGRES
2026-08-08 18:39:40,815 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 18:39:40,815 [I] Checking connection..
2026-08-08 18:39:40,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 18:39:41,078 [I] Checking connection passed.
2026-08-08 18:39:41,078 [I] --------- Verifying version history table ---------
2026-08-08 18:39:41,078 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:39:41,330 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 18:39:41,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:39:41,577 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 18:39:41,577 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 18:39:41,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 18:39:41.839 UTC [20901] WARNING: there is no transaction in progress
2026-08-08 18:39:41,849 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 18:39:41,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:39:42,118 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 18:39:42,118 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 18:39:42,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 18:39:42,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 18:39:42,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fgb3.c.gcp-upstream.internal','N') ;"
2026-08-08 18:39:42,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 18:39:43,150 [I] Table x_portal_user does not exist in database ranger
2026-08-08 18:39:43,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 18:39:43,411 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 18:39:43,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 18:39:43,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 18:39:43,887 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 18:39:43,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 18:39:44.861 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.877 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.894 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.909 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.926 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.942 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:44.998 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.005 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.020 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.030 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.041 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.055 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.065 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.072 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.080 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45.087 UTC [21076] WARNING: there is no transaction in progress
2026-08-08 18:39:45,754 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 18:39:45,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 18:39:46,009 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 18:39:46,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 18:39:46,254 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 18:39:46,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 18:39:46,512 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 18:39:46,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 18:39:46,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 18:39:47,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fgb3.c.gcp-upstream.internal';"
2026-08-08 18:39:47,281 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 18:39:47,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 18:39:47,523 [I] DB_PATCHES have already been applied
I20260808 18:39:47.528467 4343 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklYnvF7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 18:39:47.528529 4343 mini_ranger.cc:193] Using host: 127.4.61.212
I20260808 18:39:47.532647 4343 mini_ranger.cc:227] Ranger admin URL: http://127.4.61.212:48545
Aug 08, 2026 6:39:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 6:39:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 6:39:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 6:39:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 6:39:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 6:39:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 6:39:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 18:39:48.738417 4343 mini_ranger.cc:160] Time spent starting Ranger: real 8.758s user 0.008s sys 0.003s
Aug 08, 2026 6:40:09 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 6:40:09 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 6:40:09 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 6:40:09 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 6:40:10 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 18:40:10.969765 4343 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangerkms_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/rangerkms_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.61.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.61.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 18:40:11 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214411, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 18:40:11.057701 4343 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 18:40:11.067849 4343 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 18:40:11.867779 4343 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 18:40:11.867873 4343 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms
I20260808 18:40:11.867978 4343 mini_ranger_kms.cc:227] Using postgres at 127.4.61.212:34851
2026-08-08 18:40:12,665 [I] DB FLAVOR :POSTGRES
2026-08-08 18:40:12,665 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 18:40:12,666 [I] Checking connection
2026-08-08 18:40:12,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 18:40:12,974 [I] connection success
2026-08-08 18:40:12,974 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 18:40:12,974 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 18:40:12,974 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 18:40:13,247 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 18:40:13,247 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 18:40:13,247 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 18:40:13,247 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:34851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 18:40:13,533 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 18:40:14.019121 4343 mini_ranger_kms.cc:310] Created kms service
I20260808 18:40:14.189991 4343 mini_ranger_kms.cc:326] Created kudu user
I20260808 18:40:14.234356 4343 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 18:40:14 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214411, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:14.647691 4343 mini_ranger_kms.cc:384] Added ranger policy
I20260808 18:40:14.647856 4343 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 18:40:14.647883 4343 mini_ranger_kms.cc:240] Using host: 127.4.61.212
I20260808 18:40:14.652508 4343 mini_ranger_kms.cc:276] Ranger KMS PID: 21375
I20260808 18:40:14.652652 4343 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.61.212:55261
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 6:40:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 18:40:17.197724 4343 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.140s user 0.007s sys 0.660s
I20260808 18:40:17.197873 4343 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 18:40:17.198009 4343 mini_ranger_kms.cc:401] 127.4.61.212:55261/kms/v1/keys
Aug 08 18:40:17 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786214417, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 18:40:17 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214417, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
Aug 08 18:40:18 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214417, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
Aug 08 18:40:20 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:40:20.990926 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35977
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:35977
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:55261/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:40:21.174283 21447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:40:21.174556 21447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:40:21.174594 21447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:40:21.178571 21447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:40:21.178624 21447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:40:21.178643 21447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:40:21.178658 21447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:40:21.178673 21447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:40:21.184288 21447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.61.212:55261/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:35977
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:40:21.185416 21447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:40:21.186494 21447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:40:21.196768 21447 server_base.cc:1034] running on GCE node
W20260808 18:40:21.196801 21456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:21.197005 21458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:21.197077 21464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:40:21.197702 21447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:40:21.198881 21447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:40:21.200049 21447 hybrid_clock.cc:648] HybridClock initialized: now 1786214421200026 us; error 41 us; skew 500 ppm
Aug 08 18:40:21 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214421, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:40:21.206359 21447 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:40:21.207437 21447 webserver.cc:460] Webserver started at http://127.4.61.254:44811/ using document root <none> and password file <none>
I20260808 18:40:21.208016 21447 fs_manager.cc:359] Metadata directory not provided
I20260808 18:40:21.208077 21447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:40:21.208281 21447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:40:21 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214421, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:21.264113 21447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "cdfcaaa2e8b4455396fcb0595877f7f3"
format_stamp: "Formatted at 2026-08-08 18:40:21 on dist-test-slave-fgb3"
server_key: "0bf2dd7ed3e9d9d8edb87de1ac9d9de5"
server_key_iv: "0d68494e359f0a3422770f085a738b81"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:21.264899 21447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "cdfcaaa2e8b4455396fcb0595877f7f3"
format_stamp: "Formatted at 2026-08-08 18:40:21 on dist-test-slave-fgb3"
server_key: "0bf2dd7ed3e9d9d8edb87de1ac9d9de5"
server_key_iv: "0d68494e359f0a3422770f085a738b81"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:21.269676 21447 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:40:21.289454 21476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:21.290951 21447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:40:21.291080 21447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "cdfcaaa2e8b4455396fcb0595877f7f3"
format_stamp: "Formatted at 2026-08-08 18:40:21 on dist-test-slave-fgb3"
server_key: "0bf2dd7ed3e9d9d8edb87de1ac9d9de5"
server_key_iv: "0d68494e359f0a3422770f085a738b81"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:21.291222 21447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:40:21.304209 21447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:40:21.307459 21447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:40:21.307647 21447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:40:21.325139 21447 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:35977
I20260808 18:40:21.325212 21566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:35977 every 8 connection(s)
I20260808 18:40:21.326587 21447 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:40:21.330118 21567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:40:21.331063 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 21447
I20260808 18:40:21.331207 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:40:21.331535 4343 external_mini_cluster.cc:1428] Setting key 21d8f754f9c3f3f2c79257cb86b7b7cf
I20260808 18:40:21.338867 21567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: Bootstrap starting.
I20260808 18:40:21.342137 21567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: Neither blocks nor log segments found. Creating new log.
I20260808 18:40:21.343189 21567 log.cc:824] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:40:21 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:40:21.345821 21567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: No bootstrap required, opened a new log
I20260808 18:40:21.350241 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:21.333622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.4.61.254:35977)
0808 18:40:21.334363 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:21.334413 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:21.334460 (+ 47us) server_negotiation.cc:407] Connection header received
0808 18:40:21.335837 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:21.335864 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:21.336309 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:21.336708 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:40:21.337798 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:21.339486 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:21.340812 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:21.341556 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:21.341709 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:21.344882 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:40:21.344890 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:40:21.344904 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:40:21.344932 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:40:21.347354 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:21.347782 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:21.347787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:21.347792 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:21.347902 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:21.348180 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:21.348184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:21.348185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:21.348601 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:40:21.348840 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:21.349125 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 18:40:21.349444 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":253,"threads_started":1}
I20260808 18:40:21.351306 21567 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } }
I20260808 18:40:21.351624 21567 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:40:21.351684 21567 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdfcaaa2e8b4455396fcb0595877f7f3, State: Initialized, Role: FOLLOWER
I20260808 18:40:21.352205 21567 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } }
I20260808 18:40:21.352382 21567 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:40:21.352450 21567 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:40:21.352550 21567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:40:21.354353 21567 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } }
I20260808 18:40:21.354779 21567 leader_election.cc:302] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdfcaaa2e8b4455396fcb0595877f7f3; no voters:
I20260808 18:40:21.355162 21567 leader_election.cc:288] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:40:21.355430 21572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:40:21.355737 21572 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [term 1 LEADER]: Becoming Leader. State: Replica: cdfcaaa2e8b4455396fcb0595877f7f3, State: Running, Role: LEADER
I20260808 18:40:21.356081 21572 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } }
I20260808 18:40:21.356536 21567 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:40:21.357997 21576 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdfcaaa2e8b4455396fcb0595877f7f3. Latest consensus state: current_term: 1 leader_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } } }
I20260808 18:40:21.358145 21576 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [sys.catalog]: This master's current role is: LEADER
I20260808 18:40:21.358181 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfcaaa2e8b4455396fcb0595877f7f3" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35977 } } }
I20260808 18:40:21.358386 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3 [sys.catalog]: This master's current role is: LEADER
I20260808 18:40:21.358942 21591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:40:21.362984 21591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:40:21.363610 21567 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 18:40:21.375835 21591 catalog_manager.cc:1347] Generated new cluster ID: 90ed0c8eb2014c28ad6764b51d55fea0
I20260808 18:40:21.375941 21591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:40:21.443977 21591 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:40:21.445628 21591 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:40:21.454829 21591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: Generated new TSK 0
I20260808 18:40:21.455919 21591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:40:22.455242 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:55261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:40:22.644172 21645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:40:22.644521 21645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:40:22.644647 21645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:40:22.649268 21645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:40:22.649340 21645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:40:22.649406 21645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:40:22.655267 21645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.61.212:55261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:40:22.656599 21645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:40:22.658037 21645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:40:22.671700 21656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:22.671739 21665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:22.672062 21659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:40:22.672413 21645 server_base.cc:1034] running on GCE node
I20260808 18:40:22.672809 21645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:40:22.673444 21645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:40:22.674614 21645 hybrid_clock.cc:648] HybridClock initialized: now 1786214422674579 us; error 54 us; skew 500 ppm
Aug 08 18:40:22 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:40:22.678090 21645 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:40:22.678980 21645 webserver.cc:460] Webserver started at http://127.4.61.193:39063/ using document root <none> and password file <none>
I20260808 18:40:22.679529 21645 fs_manager.cc:359] Metadata directory not provided
I20260808 18:40:22.679596 21645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:40:22.679798 21645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:40:22 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:22.701846 21645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "e96d10e9dbc0477fab4c0e4958802259"
format_stamp: "Formatted at 2026-08-08 18:40:22 on dist-test-slave-fgb3"
server_key: "985b5e1573bf830145b88f5ddae95bac"
server_key_iv: "e5b50fc882f039eb2d3608086cfba485"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:22.702736 21645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "e96d10e9dbc0477fab4c0e4958802259"
format_stamp: "Formatted at 2026-08-08 18:40:22 on dist-test-slave-fgb3"
server_key: "985b5e1573bf830145b88f5ddae95bac"
server_key_iv: "e5b50fc882f039eb2d3608086cfba485"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:22.706941 21645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 18:40:22.721837 21675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:22.723286 21645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:40:22.723414 21645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "e96d10e9dbc0477fab4c0e4958802259"
format_stamp: "Formatted at 2026-08-08 18:40:22 on dist-test-slave-fgb3"
server_key: "985b5e1573bf830145b88f5ddae95bac"
server_key_iv: "e5b50fc882f039eb2d3608086cfba485"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:22.723549 21645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:40:22.781600 21645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:40:22.785493 21645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:40:22.785766 21645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:40:22.786633 21645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:40:22.787854 21645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:40:22.787951 21645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:22.788098 21645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:40:22.788182 21645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:22.812502 21645 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:46353
I20260808 18:40:22.812974 21860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:46353 every 8 connection(s)
I20260808 18:40:22.813944 21645 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:40:22.822906 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 21645
I20260808 18:40:22.823052 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:40:22.823334 4343 external_mini_cluster.cc:1428] Setting key b271743f5995a92b6f92a577f0c37186
Aug 08 18:40:22 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:40:22.838461 21866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:22.817224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:50171 (local address 127.4.61.254:35977)
0808 18:40:22.817597 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:22.817602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:22.818738 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 18:40:22.820365 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:22.820370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:22.820431 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:22.820503 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:40:22.822664 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:22.823440 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:22.829476 (+ 6036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:22.829881 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:22.829993 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:22.833668 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:40:22.833672 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:40:22.833675 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:40:22.833704 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:40:22.835753 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:22.836427 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:22.836431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:22.836433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:22.836529 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:22.836929 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:22.836933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:22.836934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:22.837170 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:40:22.837296 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:22.838091 (+ 795us) server_negotiation.cc:299] Negotiation successful
0808 18:40:22.838245 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":57,"threads_started":1}
I20260808 18:40:22.840262 21867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:22.817779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35977 (local address 127.4.61.193:50171)
0808 18:40:22.818567 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:22.818627 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:22.820100 (+ 1473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:22.821058 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:22.821068 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:22.821615 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:40:22.822471 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:22.822497 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:22.823620 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:22.823624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:22.829330 (+ 5706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:22.829346 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:22.830066 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:22.830071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:22.830382 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:22.831157 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:40:22.831181 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:40:22.833443 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:40:22.835903 (+ 2460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:22.835909 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:22.835929 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:22.836301 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:22.836633 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:22.836636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:22.836638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:22.836817 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:22.837380 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:40:22.837386 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:40:22.837761 (+ 375us) client_negotiation.cc:769] Sending connection context
0808 18:40:22.838818 (+ 1057us) client_negotiation.cc:240] Negotiation successful
0808 18:40:22.839216 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":249,"threads_started":1}
I20260808 18:40:22.841610 21862 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35977
I20260808 18:40:22.841866 21862 heartbeater.cc:464] Registering TS with master...
I20260808 18:40:22.842432 21862 heartbeater.cc:511] Master 127.4.61.254:35977 requested a full tablet report, sending...
I20260808 18:40:22.844107 21501 ts_manager.cc:194] Registered new tserver with Master: e96d10e9dbc0477fab4c0e4958802259 (127.4.61.193:46353)
I20260808 18:40:22.845312 21501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:50171
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:40:22.875720 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:55261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:40:22 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 18:40:23.052021 21874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:40:23.052297 21874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:40:23.052359 21874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:40:23.056664 21874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:40:23.056721 21874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:40:23.056808 21874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:40:23.062799 21874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.61.212:55261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:40:23.063928 21874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:40:23.064970 21874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:40:23.076664 21884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:23.076674 21882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:23.076632 21886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:40:23.077400 21874 server_base.cc:1034] running on GCE node
I20260808 18:40:23.077806 21874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:40:23.078505 21874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:40:23.079666 21874 hybrid_clock.cc:648] HybridClock initialized: now 1786214423079637 us; error 43 us; skew 500 ppm
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:40:23.083235 21874 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:40:23.084074 21874 webserver.cc:460] Webserver started at http://127.4.61.194:40755/ using document root <none> and password file <none>
I20260808 18:40:23.084625 21874 fs_manager.cc:359] Metadata directory not provided
I20260808 18:40:23.084689 21874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:40:23.084923 21874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:23.106273 21874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "2e0d7c933a4e4248a372963445303e0d"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "bd33f87d12ca2b791c91b23b52b14de7"
server_key_iv: "0f8d3f4be773d41429771addac41eeba"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.107527 21874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "2e0d7c933a4e4248a372963445303e0d"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "bd33f87d12ca2b791c91b23b52b14de7"
server_key_iv: "0f8d3f4be773d41429771addac41eeba"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.116015 21874 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260808 18:40:23.140846 21896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.142760 21874 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.001s
I20260808 18:40:23.142973 21874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "2e0d7c933a4e4248a372963445303e0d"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "bd33f87d12ca2b791c91b23b52b14de7"
server_key_iv: "0f8d3f4be773d41429771addac41eeba"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.143193 21874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:40:23.166438 21874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:40:23.170284 21874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:40:23.170583 21874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:40:23.171443 21874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:40:23.172696 21874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:40:23.172816 21874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.172914 21874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:40:23.172976 21874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.200980 21874 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:35093
I20260808 18:40:23.202594 21874 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:40:23.205170 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 21874
I20260808 18:40:23.205303 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:40:23.205622 4343 external_mini_cluster.cc:1428] Setting key 9719d25738e0015336bb9811789b67cd
I20260808 18:40:23.211388 22089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:35093 every 8 connection(s)
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:40:23.248426 21866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.215664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:44079 (local address 127.4.61.254:35977)
0808 18:40:23.215803 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.215808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.221895 (+ 6087us) server_negotiation.cc:407] Connection header received
0808 18:40:23.230882 (+ 8987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.230887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.230961 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.231023 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:40:23.233294 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.234150 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.236662 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.237028 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.237115 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.243755 (+ 6640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:40:23.243760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:40:23.243763 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:40:23.243799 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:40:23.245549 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.246275 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.246279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.246281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.246426 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.246921 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.246925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.246927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.247179 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:40:23.247286 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.248056 (+ 770us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.248209 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:40:23.253800 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.214140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35977 (local address 127.4.61.194:44079)
0808 18:40:23.221691 (+ 7551us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:23.221763 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:23.230493 (+ 8730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:23.231557 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:23.231570 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:23.232093 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:40:23.233079 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.233105 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.234360 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.234363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.236008 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.236020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.237408 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.237412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.237702 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.238514 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:40:23.238537 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:40:23.243493 (+ 4956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:40:23.245703 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:23.245710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:23.245733 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:23.246137 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:23.246573 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:23.246576 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:23.246578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:23.246803 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:23.247371 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:40:23.247379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:40:23.247758 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 18:40:23.248996 (+ 1238us) client_negotiation.cc:240] Negotiation successful
0808 18:40:23.249411 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7230,"thread_start_us":308,"threads_started":1}
I20260808 18:40:23.255803 22091 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35977
I20260808 18:40:23.256078 22091 heartbeater.cc:464] Registering TS with master...
I20260808 18:40:23.256745 22091 heartbeater.cc:511] Master 127.4.61.254:35977 requested a full tablet report, sending...
I20260808 18:40:23.258088 21501 ts_manager.cc:194] Registered new tserver with Master: 2e0d7c933a4e4248a372963445303e0d (127.4.61.194:35093)
I20260808 18:40:23.258924 21501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:44079
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:40:23.270140 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:55261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:40:23.499917 22099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:40:23.500357 22099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:40:23.500474 22099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:40:23.506153 22099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:40:23.506367 22099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:40:23.506538 22099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:40:23.514942 22099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.61.212:55261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:40:23.516611 22099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:40:23.518006 22099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:40:23.534109 22112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:23.534410 22114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:40:23.534837 22120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:40:23.536213 22099 server_base.cc:1034] running on GCE node
I20260808 18:40:23.536872 22099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:40:23.537663 22099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:40:23.539074 22099 hybrid_clock.cc:648] HybridClock initialized: now 1786214423538969 us; error 121 us; skew 500 ppm
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:40:23.543787 22099 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:40:23.544983 22099 webserver.cc:460] Webserver started at http://127.4.61.195:38661/ using document root <none> and password file <none>
I20260808 18:40:23.545771 22099 fs_manager.cc:359] Metadata directory not provided
I20260808 18:40:23.545929 22099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:40:23.546242 22099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:23.563505 22099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "0e382f241f57482ba3a944fea8d2d290"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "855a13b5ac447c4305d5877d087e716c"
server_key_iv: "da376e51c794e11fe7547f2372d7f55b"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.564500 22099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "0e382f241f57482ba3a944fea8d2d290"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "855a13b5ac447c4305d5877d087e716c"
server_key_iv: "da376e51c794e11fe7547f2372d7f55b"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.571138 22099 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 18:40:23.593271 22133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.595208 22099 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 18:40:23.595366 22099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "0e382f241f57482ba3a944fea8d2d290"
format_stamp: "Formatted at 2026-08-08 18:40:23 on dist-test-slave-fgb3"
server_key: "855a13b5ac447c4305d5877d087e716c"
server_key_iv: "da376e51c794e11fe7547f2372d7f55b"
server_key_version: "kuduclusterkey@0"
I20260808 18:40:23.595500 22099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:40:23.614828 22099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:40:23.618855 22099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:40:23.619156 22099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:40:23.620038 22099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:40:23.621115 22099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:40:23.621219 22099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.621316 22099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:40:23.621395 22099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:40:23.652001 22099 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:40093
I20260808 18:40:23.653498 22099 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:40:23.655647 22313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:40093 every 8 connection(s)
I20260808 18:40:23.656453 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 22099
I20260808 18:40:23.656584 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:40:23.656942 4343 external_mini_cluster.cc:1428] Setting key af70399f866e56692fffad5722545b46
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214423, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:40:23.674837 21866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.660063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50657 (local address 127.4.61.254:35977)
0808 18:40:23.660201 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.660216 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.660720 (+ 504us) server_negotiation.cc:407] Connection header received
0808 18:40:23.662267 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.662271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.662358 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.662451 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:40:23.664225 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.665069 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.666986 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.667367 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.667480 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.670854 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:40:23.670858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:40:23.670861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:40:23.670890 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:40:23.672335 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.672942 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.672947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.672948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.673039 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.673441 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.673445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.673446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.673667 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:40:23.673750 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.674524 (+ 774us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.674656 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:40:23.675711 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.658746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35977 (local address 127.4.61.195:50657)
0808 18:40:23.660390 (+ 1644us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:23.660449 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:23.662042 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:23.662636 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:23.662646 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:23.663198 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:40:23.664046 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.664067 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.665218 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.665222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.666834 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.666846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.667540 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.667545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.667813 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.668583 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:40:23.668604 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:40:23.670661 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:40:23.672450 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:23.672456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:23.672470 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:23.672816 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:23.673148 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:40:23.673151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:40:23.673153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:40:23.673332 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:40:23.673835 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:40:23.673841 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:40:23.674162 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 18:40:23.674396 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 18:40:23.674699 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1369,"thread_start_us":258,"threads_started":1}
I20260808 18:40:23.677243 22314 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35977
I20260808 18:40:23.677508 22314 heartbeater.cc:464] Registering TS with master...
I20260808 18:40:23.678094 22314 heartbeater.cc:511] Master 127.4.61.254:35977 requested a full tablet report, sending...
I20260808 18:40:23.679268 21501 ts_manager.cc:194] Registered new tserver with Master: 0e382f241f57482ba3a944fea8d2d290 (127.4.61.195:40093)
I20260808 18:40:23.680033 21501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:50657
I20260808 18:40:23.685557 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:40:23.709622 21866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.690860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39374 (local address 127.4.61.254:35977)
0808 18:40:23.690975 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.690979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.693700 (+ 2721us) server_negotiation.cc:407] Connection header received
0808 18:40:23.693847 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.693850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.693901 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.693963 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:40:23.700982 (+ 7019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.701584 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.703007 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.703358 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.703471 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.705492 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:40:23.705496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:40:23.705499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:40:23.705529 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:40:23.707060 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.708141 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.708145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.708146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.708249 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:40:23.708578 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:40:23.708582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:40:23.708584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:40:23.708833 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:40:23.708963 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.709317 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.709451 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:40:23.714090 21501 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:40:23.718845 21501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:40:23.742581 22336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.732664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:35093 (local address 127.0.0.1:41830)
0808 18:40:23.734148 (+ 1484us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:23.734197 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:23.734533 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:23.735664 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:23.735671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:23.735694 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:40:23.735836 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.735843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.737479 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.737483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.739580 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.739592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.741211 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.741216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.742090 (+ 874us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.742140 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 18:40:23.742258 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 18:40:23.742422 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1304,"thread_start_us":211,"threads_started":1}
I20260808 18:40:23.743244 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.733594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41830 (local address 127.4.61.194:35093)
0808 18:40:23.734819 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.734835 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.734857 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:40:23.734931 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.734937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.735137 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.735475 (+ 338us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:40:23.735967 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.737343 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.739869 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.740820 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.740947 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.741115 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.742931 (+ 1816us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.743046 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1112,"thread_start_us":145,"threads_started":1}
I20260808 18:40:23.746917 21954 tablet_service.cc:1467] Processing CreateTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc (DEFAULT_TABLE table=test-table [id=d1336f855dcd4ce2955a25e170c86ec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:40:23.748212 21954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06ef4427cf174d2d829f1c9b96fa11cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:40:23.751581 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.732938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48500 (local address 127.4.61.193:46353)
0808 18:40:23.733720 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.733728 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.738207 (+ 4479us) server_negotiation.cc:407] Connection header received
0808 18:40:23.739875 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.739881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.740080 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.740395 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:40:23.742019 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.743235 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.749749 (+ 6514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.750683 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.750780 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.750913 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.751287 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.751396 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":74,"threads_started":1}
I20260808 18:40:23.752158 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.732786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46353 (local address 127.0.0.1:48500)
0808 18:40:23.737918 (+ 5132us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:23.737932 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:23.739714 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:23.740572 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:23.740575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:23.740592 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:40:23.740672 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.740678 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.743526 (+ 2848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.743529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.744818 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.744830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.751031 (+ 6201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.751035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.751131 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.751154 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:40:23.751858 (+ 704us) client_negotiation.cc:240] Negotiation successful
0808 18:40:23.751945 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5066,"thread_start_us":166,"threads_started":1}
I20260808 18:40:23.753283 22341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.734114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.4.61.195:40093)
0808 18:40:23.737685 (+ 3571us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:23.737724 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:23.741207 (+ 3483us) server_negotiation.cc:407] Connection header received
0808 18:40:23.741288 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:23.741293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:23.741471 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:23.741843 (+ 372us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:40:23.745156 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.746534 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.748336 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.749368 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.749470 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.749634 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:23.752974 (+ 3340us) server_negotiation.cc:299] Negotiation successful
0808 18:40:23.753083 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3464,"thread_start_us":225,"threads_started":1}
I20260808 18:40:23.752684 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:23.733935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:40093 (local address 127.0.0.1:34418)
0808 18:40:23.740833 (+ 6898us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:23.740845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:23.741113 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:23.744942 (+ 3829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:23.744946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:23.744964 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:40:23.745039 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.745044 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.746664 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.746667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.748031 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:23.748043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:23.752313 (+ 4270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:23.752317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:23.752409 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:23.752433 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:40:23.752498 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 18:40:23.752561 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6834,"thread_start_us":167,"threads_started":1}
I20260808 18:40:23.756067 21764 tablet_service.cc:1467] Processing CreateTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc (DEFAULT_TABLE table=test-table [id=d1336f855dcd4ce2955a25e170c86ec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:40:23.756529 22210 tablet_service.cc:1467] Processing CreateTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc (DEFAULT_TABLE table=test-table [id=d1336f855dcd4ce2955a25e170c86ec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:40:23.757309 21764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06ef4427cf174d2d829f1c9b96fa11cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:40:23.757639 22210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06ef4427cf174d2d829f1c9b96fa11cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:40:23.767042 22344 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Bootstrap starting.
I20260808 18:40:23.767593 22347 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Bootstrap starting.
I20260808 18:40:23.768025 22342 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Bootstrap starting.
I20260808 18:40:23.770800 22344 tablet_bootstrap.cc:654] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Neither blocks nor log segments found. Creating new log.
I20260808 18:40:23.772274 22344 log.cc:824] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Log is configured to *not* fsync() on all Append() calls
I20260808 18:40:23.773020 22347 tablet_bootstrap.cc:654] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Neither blocks nor log segments found. Creating new log.
I20260808 18:40:23.773638 22342 tablet_bootstrap.cc:654] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Neither blocks nor log segments found. Creating new log.
I20260808 18:40:23.774864 22344 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: No bootstrap required, opened a new log
I20260808 18:40:23.775082 22344 ts_tablet_manager.cc:1397] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260808 18:40:23.776778 22347 log.cc:824] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Log is configured to *not* fsync() on all Append() calls
I20260808 18:40:23.776793 22342 log.cc:824] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:40:23.779120 22342 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: No bootstrap required, opened a new log
I20260808 18:40:23.779177 22347 tablet_bootstrap.cc:492] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: No bootstrap required, opened a new log
I20260808 18:40:23.779318 22342 ts_tablet_manager.cc:1397] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 18:40:23.779321 22347 ts_tablet_manager.cc:1397] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260808 18:40:23.782526 22344 raft_consensus.cc:348] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.782819 22344 raft_consensus.cc:374] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:40:23.782881 22344 raft_consensus.cc:729] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e382f241f57482ba3a944fea8d2d290, State: Initialized, Role: FOLLOWER
I20260808 18:40:23.783401 22344 consensus_queue.cc:260] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.784511 22344 ts_tablet_manager.cc:1428] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 18:40:23.784631 22342 raft_consensus.cc:348] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.784895 22342 raft_consensus.cc:374] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:40:23.784898 22314 heartbeater.cc:503] Master 127.4.61.254:35977 was elected leader, sending a full tablet report...
I20260808 18:40:23.784957 22342 raft_consensus.cc:729] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0d7c933a4e4248a372963445303e0d, State: Initialized, Role: FOLLOWER
I20260808 18:40:23.785899 22342 consensus_queue.cc:260] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.787139 22342 ts_tablet_manager.cc:1428] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 18:40:23.787523 22091 heartbeater.cc:503] Master 127.4.61.254:35977 was elected leader, sending a full tablet report...
I20260808 18:40:23.789577 22347 raft_consensus.cc:348] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.789849 22347 raft_consensus.cc:374] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:40:23.789919 22347 raft_consensus.cc:729] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96d10e9dbc0477fab4c0e4958802259, State: Initialized, Role: FOLLOWER
I20260808 18:40:23.790441 22347 consensus_queue.cc:260] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:23.791664 22347 ts_tablet_manager.cc:1428] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260808 18:40:23.792028 21862 heartbeater.cc:503] Master 127.4.61.254:35977 was elected leader, sending a full tablet report...
W20260808 18:40:23.818220 21864 tablet.cc:2369] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:40:23.907356 22315 tablet.cc:2369] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:40:23.967100 22093 tablet.cc:2369] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 18:40:23 dist-test-slave-fgb3 krb5kdc[20728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214422, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:40:24.014632 22352 raft_consensus.cc:482] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:40:24.015020 22352 raft_consensus.cc:504] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:24.016714 22352 leader_election.cc:288] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e0d7c933a4e4248a372963445303e0d (127.4.61.194:35093), e96d10e9dbc0477fab4c0e4958802259 (127.4.61.193:46353)
I20260808 18:40:24.022825 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.017195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46353 (local address 127.4.61.195:54683)
0808 18:40:24.017563 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:24.017579 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:24.017676 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:24.018441 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:24.018444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:24.018468 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:40:24.018647 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:24.018657 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.019701 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.019704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:24.020871 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:24.020883 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.022288 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.022291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:24.022491 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:24.022520 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 18:40:24.022596 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 18:40:24.022677 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270}
I20260808 18:40:24.022825 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.017520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:54683 (local address 127.4.61.193:46353)
0808 18:40:24.017633 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:24.017638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:24.017652 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:40:24.017780 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:24.017783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:24.017847 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:24.017911 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:40:24.018760 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.019494 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.020992 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.021561 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.021665 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:24.021720 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:24.022624 (+ 904us) server_negotiation.cc:299] Negotiation successful
0808 18:40:24.022701 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:40:24.023988 21788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06ef4427cf174d2d829f1c9b96fa11cc" candidate_uuid: "0e382f241f57482ba3a944fea8d2d290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e96d10e9dbc0477fab4c0e4958802259" is_pre_election: true
I20260808 18:40:24.024376 21788 raft_consensus.cc:2454] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e382f241f57482ba3a944fea8d2d290 in term 0.
I20260808 18:40:24.025043 22134 leader_election.cc:302] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e382f241f57482ba3a944fea8d2d290, e96d10e9dbc0477fab4c0e4958802259; no voters:
I20260808 18:40:24.025390 22352 raft_consensus.cc:2781] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:40:24.025480 22352 raft_consensus.cc:482] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:40:24.025525 22352 raft_consensus.cc:3037] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:40:24.026404 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.018552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47435 (local address 127.4.61.194:35093)
0808 18:40:24.018690 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:24.018694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:24.019313 (+ 619us) server_negotiation.cc:407] Connection header received
0808 18:40:24.019495 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:24.019498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:24.019547 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:24.019591 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:40:24.021492 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.022155 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.024816 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.025399 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.025492 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:24.025545 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:24.026150 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 18:40:24.026238 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 18:40:24.026854 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.017954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:35093 (local address 127.4.61.195:47435)
0808 18:40:24.018996 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:24.019010 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:40:24.019386 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:40:24.021037 (+ 1651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:40:24.021039 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:40:24.021060 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:40:24.021350 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:24.021358 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.023325 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.023328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:24.024655 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:40:24.024668 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.025831 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.025838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:40:24.025984 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:24.026012 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 18:40:24.026561 (+ 549us) client_negotiation.cc:240] Negotiation successful
0808 18:40:24.026641 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":958,"thread_start_us":169,"threads_started":1}
I20260808 18:40:24.027474 22010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06ef4427cf174d2d829f1c9b96fa11cc" candidate_uuid: "0e382f241f57482ba3a944fea8d2d290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e0d7c933a4e4248a372963445303e0d" is_pre_election: true
I20260808 18:40:24.027633 22352 raft_consensus.cc:504] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:24.027807 22010 raft_consensus.cc:2454] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e382f241f57482ba3a944fea8d2d290 in term 0.
I20260808 18:40:24.028044 22352 leader_election.cc:288] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [CANDIDATE]: Term 1 election: Requested vote from peers 2e0d7c933a4e4248a372963445303e0d (127.4.61.194:35093), e96d10e9dbc0477fab4c0e4958802259 (127.4.61.193:46353)
I20260808 18:40:24.028594 21788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06ef4427cf174d2d829f1c9b96fa11cc" candidate_uuid: "0e382f241f57482ba3a944fea8d2d290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e96d10e9dbc0477fab4c0e4958802259"
I20260808 18:40:24.028728 21788 raft_consensus.cc:3037] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:40:24.028779 22010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06ef4427cf174d2d829f1c9b96fa11cc" candidate_uuid: "0e382f241f57482ba3a944fea8d2d290" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e0d7c933a4e4248a372963445303e0d"
I20260808 18:40:24.028913 22010 raft_consensus.cc:3037] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:40:24.030001 21788 raft_consensus.cc:2454] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e382f241f57482ba3a944fea8d2d290 in term 1.
I20260808 18:40:24.030355 22134 leader_election.cc:302] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e382f241f57482ba3a944fea8d2d290, e96d10e9dbc0477fab4c0e4958802259; no voters:
I20260808 18:40:24.030959 22010 raft_consensus.cc:2454] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e382f241f57482ba3a944fea8d2d290 in term 1.
I20260808 18:40:24.031550 22352 raft_consensus.cc:2781] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:40:24.032001 22352 raft_consensus.cc:686] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 1 LEADER]: Becoming Leader. State: Replica: 0e382f241f57482ba3a944fea8d2d290, State: Running, Role: LEADER
I20260808 18:40:24.032708 22352 consensus_queue.cc:237] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } }
I20260808 18:40:24.036594 21495 catalog_manager.cc:5495] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e382f241f57482ba3a944fea8d2d290 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "0e382f241f57482ba3a944fea8d2d290" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e382f241f57482ba3a944fea8d2d290" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 40093 } health_report { overall_health: HEALTHY } } }
I20260808 18:40:24.127151 22341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.122413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.4.61.195:40093)
0808 18:40:24.122537 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:40:24.122541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:40:24.122556 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:40:24.122660 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:40:24.122664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:40:24.122729 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:40:24.122858 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:40:24.123167 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.124003 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.125263 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:40:24.125614 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:40:24.125724 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:40:24.126118 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:40:24.126716 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:40:24.126860 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 18:40:24.126951 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 18:40:24.127017 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:40:24.134267 21788 raft_consensus.cc:1261] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259 [term 1 FOLLOWER]: Refusing update from remote peer 0e382f241f57482ba3a944fea8d2d290: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:40:24.135301 22352 consensus_queue.cc:1035] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e96d10e9dbc0477fab4c0e4958802259" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:40:24.136551 22010 raft_consensus.cc:1261] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 1 FOLLOWER]: Refusing update from remote peer 0e382f241f57482ba3a944fea8d2d290: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:40:24.137269 22352 consensus_queue.cc:1035] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e0d7c933a4e4248a372963445303e0d" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:40:24.148747 22367 mvcc.cc:205] Tried to move back new op lower bound from 7316334281245679616 to 7316334280840761344. Current Snapshot: MvccSnapshot[applied={T|T < 7316334281245679616}]
I20260808 18:40:24.150007 22365 mvcc.cc:205] Tried to move back new op lower bound from 7316334281245679616 to 7316334280840761344. Current Snapshot: MvccSnapshot[applied={T|T < 7316334281245679616}]
I20260808 18:40:24.165366 21495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:40:24.165585 21495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:40:24.168746 21495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cdfcaaa2e8b4455396fcb0595877f7f3: Sending DeleteTablet for 3 replicas of tablet 06ef4427cf174d2d829f1c9b96fa11cc
I20260808 18:40:24.170535 21764 tablet_service.cc:1514] Processing DeleteTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:40:24 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:48500
I20260808 18:40:24.170567 22210 tablet_service.cc:1514] Processing DeleteTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:40:24 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:34418
I20260808 18:40:24.171110 21954 tablet_service.cc:1514] Processing DeleteTablet for tablet 06ef4427cf174d2d829f1c9b96fa11cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:40:24 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:41830
I20260808 18:40:24.171895 22381 tablet_replica.cc:330] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: stopping tablet replica
I20260808 18:40:24.172159 22380 tablet_replica.cc:330] T 06ef4427cf174d2d829f1c9b96fa11cc P e96d10e9dbc0477fab4c0e4958802259: stopping tablet replica
I20260808 18:40:24.172334 22381 raft_consensus.cc:2229] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:40:24.172399 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 21645
I20260808 18:40:24.173290 22383 tablet_replica.cc:330] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: stopping tablet replica
I20260808 18:40:24.173590 22383 raft_consensus.cc:2229] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:40:24.173705 22381 raft_consensus.cc:2258] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:40:24.174018 22383 raft_consensus.cc:2258] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:40:24.177191 22381 ts_tablet_manager.cc:1905] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:40:24.180455 22381 ts_tablet_manager.cc:1918] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:40:24.180562 22381 log.cc:1196] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/06ef4427cf174d2d829f1c9b96fa11cc
I20260808 18:40:24.180913 22381 ts_tablet_manager.cc:1939] T 06ef4427cf174d2d829f1c9b96fa11cc P 2e0d7c933a4e4248a372963445303e0d: Deleting consensus metadata
I20260808 18:40:24.182497 21482 catalog_manager.cc:4841] TS 2e0d7c933a4e4248a372963445303e0d (127.4.61.194:35093): tablet 06ef4427cf174d2d829f1c9b96fa11cc (table test-table [id=d1336f855dcd4ce2955a25e170c86ec5]) successfully deleted
W20260808 18:40:24.187318 21477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:46353 (error 108)
I20260808 18:40:24.188493 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:40:24.188138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46353 (local address 127.0.0.1:48514)
0808 18:40:24.188309 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 18:40:24.188391 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 18:40:24.188596 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 21874
W20260808 18:40:24.188666 21477 catalog_manager.cc:4584] TS e96d10e9dbc0477fab4c0e4958802259 (127.4.61.193:46353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 06ef4427cf174d2d829f1c9b96fa11cc: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46353: connect: Connection refused (error 111)
I20260808 18:40:24.194722 22383 ts_tablet_manager.cc:1905] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:40:24.197695 22383 ts_tablet_manager.cc:1918] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:40:24.197804 22383 log.cc:1196] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/06ef4427cf174d2d829f1c9b96fa11cc
I20260808 18:40:24.198140 22383 ts_tablet_manager.cc:1939] T 06ef4427cf174d2d829f1c9b96fa11cc P 0e382f241f57482ba3a944fea8d2d290: Deleting consensus metadata
I20260808 18:40:24.199532 21482 catalog_manager.cc:4841] TS 0e382f241f57482ba3a944fea8d2d290 (127.4.61.195:40093): tablet 06ef4427cf174d2d829f1c9b96fa11cc (table test-table [id=d1336f855dcd4ce2955a25e170c86ec5]) successfully deleted
I20260808 18:40:24.206604 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 22099
I20260808 18:40:24.220625 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 21447
I20260808 18:40:24.240949 4343 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 18:40:24.596201 4343 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 18:40:24.596343 4343 mini_ranger.cc:66] Stopping Ranger...
I20260808 18:40:24.941308 4343 mini_ranger.cc:68] Stopped Ranger
2026-08-08 18:40:24.941 UTC [20784] LOG: received smart shutdown request
2026-08-08 18:40:24.945 UTC [20784] LOG: background worker "logical replication launcher" (PID 20795) exited with exit code 1
2026-08-08 18:40:24.945 UTC [20789] LOG: shutting down
2026-08-08 18:40:25.114 UTC [20784] LOG: database system is shut down
2026-08-08T18:40:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50087 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:40:25 dist-test-slave-fgb3 krb5kdc[22403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:40:25 dist-test-slave-fgb3 krb5kdc[22403](info): set up 2 sockets
Aug 08 18:40:25 dist-test-slave-fgb3 krb5kdc[22403](info): commencing operation
krb5kdc: starting...
W20260808 18:40:26.359578 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:40:26 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:40:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:40:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangeradmin_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangeradmin_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangerlookup_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangerlookup_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
I20260808 18:40:26.533099 4343 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklYnvF7/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/postgres -l logfile start
2026-08-08 18:40:28.908 UTC [22447] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 18:40:28.908 UTC [22447] LOG: listening on IPv4 address "127.4.61.212", port 33681
2026-08-08 18:40:28.911 UTC [22447] LOG: listening on Unix socket "/tmp/.s.PGSQL.33681"
2026-08-08 18:40:28.931 UTC [22454] LOG: database system was shut down at 2026-08-08 18:40:27 UTC
2026-08-08 18:40:28.935 UTC [22447] LOG: database system is ready to accept connections
I20260808 18:40:29.997041 4343 mini_postgres.cc:96] Postgres bound to 33681
2026-08-08 18:40:30.004 UTC [22465] FATAL: database "slave" does not exist
127.4.61.212:33681 - accepting connections
I20260808 18:40:30.004909 4343 mini_ranger.cc:161] Starting Ranger...
I20260808 18:40:30.020562 4343 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 18:40:30.467645 4343 mini_ranger.cc:87] Created ranger Postgres database
I20260808 18:40:30.467730 4343 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin
2026-08-08 18:40:30,754 [I] DB FLAVOR :POSTGRES
2026-08-08 18:40:30,754 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 18:40:30,754 [I] Checking connection..
2026-08-08 18:40:30,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 18:40:31,016 [I] Checking connection passed.
2026-08-08 18:40:31,016 [I] --------- Verifying version history table ---------
2026-08-08 18:40:31,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:40:31,279 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 18:40:31,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:40:31,517 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 18:40:31,517 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 18:40:31,518 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 18:40:31.772 UTC [22567] WARNING: there is no transaction in progress
2026-08-08 18:40:31,780 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 18:40:31,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 18:40:32,041 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 18:40:32,042 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 18:40:32,042 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 18:40:32,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 18:40:32,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fgb3.c.gcp-upstream.internal','N') ;"
2026-08-08 18:40:32,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 18:40:33,047 [I] Table x_portal_user does not exist in database ranger
2026-08-08 18:40:33,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 18:40:33,300 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 18:40:33,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 18:40:33,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 18:40:33,810 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 18:40:33,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 18:40:34.714 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.729 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.745 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.759 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.774 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.791 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.845 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.851 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.865 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.875 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.884 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.898 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.908 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.914 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.920 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:34.927 UTC [22744] WARNING: there is no transaction in progress
2026-08-08 18:40:35,501 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 18:40:35,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 18:40:35,743 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 18:40:35,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 18:40:36,001 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 18:40:36,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 18:40:36,247 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 18:40:36,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 18:40:36,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 18:40:36,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fgb3.c.gcp-upstream.internal';"
2026-08-08 18:40:37,004 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 18:40:37,004 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 18:40:37,255 [I] DB_PATCHES have already been applied
I20260808 18:40:37.260751 4343 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklYnvF7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 18:40:37.260820 4343 mini_ranger.cc:193] Using host: 127.4.61.212
I20260808 18:40:37.265350 4343 mini_ranger.cc:227] Ranger admin URL: http://127.4.61.212:53433
Aug 08, 2026 6:40:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 6:40:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 6:40:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 6:40:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 6:40:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 6:40:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 6:40:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 18:40:38.496944 4343 mini_ranger.cc:160] Time spent starting Ranger: real 8.492s user 0.006s sys 0.005s
Aug 08, 2026 6:40:58 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 6:40:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 6:40:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 6:40:58 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 6:40:59 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 18:41:00.015472 4343 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.61.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.61.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangerkms_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.61.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/rangerkms_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.61.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.61.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.61.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/HTTP_127.4.61.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 18:41:00 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214460, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 18:41:00.105192 4343 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 18:41:00.114784 4343 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 18:41:00.912379 4343 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 18:41:00.912473 4343 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms
I20260808 18:41:00.912489 4343 mini_ranger_kms.cc:227] Using postgres at 127.4.61.212:33681
2026-08-08 18:41:01,135 [I] DB FLAVOR :POSTGRES
2026-08-08 18:41:01,135 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 18:41:01,135 [I] Checking connection
2026-08-08 18:41:01,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 18:41:01,388 [I] connection success
2026-08-08 18:41:01,388 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 18:41:01,388 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 18:41:01,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 18:41:01,657 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 18:41:01,657 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 18:41:01,657 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 18:41:01,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.61.212:33681/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 18:41:01,906 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 18:41:02.372541 4343 mini_ranger_kms.cc:310] Created kms service
I20260808 18:41:02.608654 4343 mini_ranger_kms.cc:326] Created kudu user
I20260808 18:41:02.649600 4343 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 18:41:02 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214460, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:03.047138 4343 mini_ranger_kms.cc:384] Added ranger policy
I20260808 18:41:03.047300 4343 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklYnvF7/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklYnvF7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 18:41:03.047329 4343 mini_ranger_kms.cc:240] Using host: 127.4.61.212
I20260808 18:41:03.052099 4343 mini_ranger_kms.cc:276] Ranger KMS PID: 23026
I20260808 18:41:03.052196 4343 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.61.212:36705
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 6:41:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 18:41:05 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786214465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:05.655339 4343 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.550s user 0.004s sys 0.203s
I20260808 18:41:05.655474 4343 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 18:41:05.655541 4343 mini_ranger_kms.cc:401] 127.4.61.212:36705/kms/v1/keys
Aug 08 18:41:05 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
Aug 08 18:41:06 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.61.212@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
Aug 08 18:41:08 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:41:08.625094 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45719
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45719
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:08.773907 23110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:08.774185 23110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:08.774242 23110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:08.778264 23110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:08.778362 23110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:08.778391 23110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:08.778414 23110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:08.778445 23110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:08.784328 23110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.61.212:36705/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45719
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:08.785476 23110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:08.786574 23110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:08.795300 23118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:08.795508 23110 server_base.cc:1034] running on GCE node
W20260808 18:41:08.795300 23116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:08.795598 23120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:08.796156 23110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:08.797283 23110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:08.798463 23110 hybrid_clock.cc:648] HybridClock initialized: now 1786214468798439 us; error 44 us; skew 500 ppm
Aug 08 18:41:08 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214468, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:08.804292 23110 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:08.805449 23110 webserver.cc:460] Webserver started at http://127.4.61.254:40535/ using document root <none> and password file <none>
I20260808 18:41:08.806026 23110 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:08.806085 23110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:08.806293 23110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:41:08 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214468, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:08.860193 23110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "415df95769d94b3eb47dd167c0c52ed9"
format_stamp: "Formatted at 2026-08-08 18:41:08 on dist-test-slave-fgb3"
server_key: "4935cfc2f947809fdd7d9fe17a242932"
server_key_iv: "ba724e791d397151b9565496267812c8"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:08.860944 23110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "415df95769d94b3eb47dd167c0c52ed9"
format_stamp: "Formatted at 2026-08-08 18:41:08 on dist-test-slave-fgb3"
server_key: "4935cfc2f947809fdd7d9fe17a242932"
server_key_iv: "ba724e791d397151b9565496267812c8"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:08.865684 23110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 18:41:08.883899 23132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:08.885711 23110 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 18:41:08.885869 23110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "415df95769d94b3eb47dd167c0c52ed9"
format_stamp: "Formatted at 2026-08-08 18:41:08 on dist-test-slave-fgb3"
server_key: "4935cfc2f947809fdd7d9fe17a242932"
server_key_iv: "ba724e791d397151b9565496267812c8"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:08.886045 23110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:08.904292 23110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:08.907481 23110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:08.907646 23110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:08.914605 23110 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:45719
I20260808 18:41:08.914623 23218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:45719 every 8 connection(s)
I20260808 18:41:08.915560 23110 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:08.918295 23219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:08.923846 23219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Bootstrap starting.
I20260808 18:41:08.924067 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 23110
I20260808 18:41:08.924198 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:41:08.924508 4343 external_mini_cluster.cc:1428] Setting key 631fe5e8d36daab5f757b5cb500e0318
I20260808 18:41:08.926597 23219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:08.927315 23219 log.cc:824] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:08.929268 23219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: No bootstrap required, opened a new log
Aug 08 18:41:08 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:08.933553 23219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:08.933792 23219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:08.933852 23219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415df95769d94b3eb47dd167c0c52ed9, State: Initialized, Role: FOLLOWER
I20260808 18:41:08.934360 23219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:08.934538 23219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:08.934609 23219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:08.934715 23219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:08.935920 23219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:08.936283 23219 leader_election.cc:302] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 415df95769d94b3eb47dd167c0c52ed9; no voters:
I20260808 18:41:08.936597 23219 leader_election.cc:288] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:41:08.936686 23224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:08.936903 23224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 LEADER]: Becoming Leader. State: Replica: 415df95769d94b3eb47dd167c0c52ed9, State: Running, Role: LEADER
I20260808 18:41:08.937259 23224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:08.937891 23219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:08.938946 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:08.925873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55182 (local address 127.4.61.254:45719)
0808 18:41:08.926283 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:08.926299 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:08.926358 (+ 59us) server_negotiation.cc:407] Connection header received
0808 18:41:08.927020 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:08.927040 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:08.927369 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:08.927681 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:08.928453 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:08.929449 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:08.930637 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:08.931098 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:08.931209 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:08.933804 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:08.933812 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:08.933829 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:08.933861 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:08.935767 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:08.936222 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:08.936229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:08.936235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:08.936375 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:08.936655 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:08.936659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:08.936661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:08.937181 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:08.937373 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:08.937661 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 18:41:08.937950 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":116,"threads_started":1}
I20260808 18:41:08.939157 23227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 415df95769d94b3eb47dd167c0c52ed9. Latest consensus state: current_term: 1 leader_uuid: "415df95769d94b3eb47dd167c0c52ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } } }
I20260808 18:41:08.939299 23227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:08.940136 23219 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 18:41:08.939157 23226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "415df95769d94b3eb47dd167c0c52ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } } }
I20260808 18:41:08.940353 23226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:08.943015 23236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:08.946727 23236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:08.952131 23236 catalog_manager.cc:1347] Generated new cluster ID: b44ac065ebe94104adab177dce6c543f
I20260808 18:41:08.952191 23236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:08.969264 23236 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:41:08.970723 23236 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:08.976732 23236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Generated new TSK 0
I20260808 18:41:08.977687 23236 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:41:09.673733 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:09.816584 23290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:09.816903 23290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:09.816967 23290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:09.821043 23290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:09.821115 23290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:09.821197 23290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:09.826504 23290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:09.827613 23290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:09.828634 23290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:09.839214 23302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:09.839715 23300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:09.840150 23306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:09.840322 23290 server_base.cc:1034] running on GCE node
I20260808 18:41:09.840766 23290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:09.841523 23290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:09.842713 23290 hybrid_clock.cc:648] HybridClock initialized: now 1786214469842643 us; error 82 us; skew 500 ppm
Aug 08 18:41:09 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214469, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:09.846349 23290 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:09.847469 23290 webserver.cc:460] Webserver started at http://127.4.61.193:42357/ using document root <none> and password file <none>
I20260808 18:41:09.848238 23290 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:09.848387 23290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:09.848671 23290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:41:09 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214469, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:09.877600 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "a38c358f96574c5692bf537db1450183"
format_stamp: "Formatted at 2026-08-08 18:41:09 on dist-test-slave-fgb3"
server_key: "24b5f92ca8ffcb71616fb5508fc04d54"
server_key_iv: "4dfbf602c57fe10ec9029a746392a885"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:09.878506 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "a38c358f96574c5692bf537db1450183"
format_stamp: "Formatted at 2026-08-08 18:41:09 on dist-test-slave-fgb3"
server_key: "24b5f92ca8ffcb71616fb5508fc04d54"
server_key_iv: "4dfbf602c57fe10ec9029a746392a885"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:09.884128 23290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260808 18:41:09.913276 23323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:09.914994 23290 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 18:41:09.915129 23290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "a38c358f96574c5692bf537db1450183"
format_stamp: "Formatted at 2026-08-08 18:41:09 on dist-test-slave-fgb3"
server_key: "24b5f92ca8ffcb71616fb5508fc04d54"
server_key_iv: "4dfbf602c57fe10ec9029a746392a885"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:09.915268 23290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:09.939229 23290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:09.942824 23290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:09.943017 23290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:09.943677 23290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:09.944744 23290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:09.944818 23290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:09.944877 23290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:09.944902 23290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:09.958577 23290 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:42065
I20260808 18:41:09.959762 23290 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:09.961167 23491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:42065 every 8 connection(s)
I20260808 18:41:09.963196 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 23290
I20260808 18:41:09.963316 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:41:09.963624 4343 external_mini_cluster.cc:1428] Setting key 0e9fd30682d5e15b4b459f7aa5ea677e
Aug 08 18:41:09 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214469, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:41:09.983465 23496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:09.964993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:59265 (local address 127.4.61.254:45719)
0808 18:41:09.971201 (+ 6208us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:09.971210 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:09.971224 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:41:09.971266 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:09.971268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:09.971319 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:09.971405 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:09.973313 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:09.973899 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:09.975426 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:09.975772 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:09.975889 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:09.979056 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:09.979061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:09.979064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:09.979092 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:09.980926 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:09.981521 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:09.981524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:09.981526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:09.981619 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:09.982024 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:09.982028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:09.982030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:09.982255 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:09.982375 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:09.983130 (+ 755us) server_negotiation.cc:299] Negotiation successful
0808 18:41:09.983264 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6121,"thread_start_us":95,"threads_started":1}
I20260808 18:41:09.984302 23495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:09.963882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.193:59265)
0808 18:41:09.969629 (+ 5747us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:09.969689 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:09.970750 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:09.971784 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:09.971794 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:09.972537 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:09.973137 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:09.973152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:09.974010 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:09.974014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:09.975280 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:09.975292 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:09.976072 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:09.976077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:09.976285 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:09.976991 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:09.977013 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:09.978864 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:09.981053 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:09.981059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:09.981075 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:09.981402 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:09.981717 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:09.981720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:09.981722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:09.981909 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:09.982433 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:09.982439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:09.982749 (+ 310us) client_negotiation.cc:769] Sending connection context
0808 18:41:09.982955 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 18:41:09.983282 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5501,"thread_start_us":146,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:41:09.985644 23492 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:09.985900 23492 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:09.986492 23492 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
Aug 08 18:41:09 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786214469, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:09.988807 23163 ts_manager.cc:194] Registered new tserver with Master: a38c358f96574c5692bf537db1450183 (127.4.61.193:42065)
I20260808 18:41:09.990408 23163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:59265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:41:10.005476 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:10.156533 23500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:10.156961 23500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:10.157032 23500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:10.163388 23500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:10.163480 23500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:10.163568 23500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:10.171634 23500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:10.173132 23500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:10.174517 23500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:10.187719 23512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:10.188099 23509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:10.189019 23507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:10.189317 23500 server_base.cc:1034] running on GCE node
I20260808 18:41:10.189852 23500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:10.190737 23500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:10.198169 23500 hybrid_clock.cc:648] HybridClock initialized: now 1786214470198114 us; error 69 us; skew 500 ppm
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:10.202189 23500 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:10.205484 23500 webserver.cc:460] Webserver started at http://127.4.61.194:43895/ using document root <none> and password file <none>
I20260808 18:41:10.206254 23500 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:10.206368 23500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:10.206627 23500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:10.222954 23500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "69a200534a6640fbb8b6e74a7cc893d5"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "376104b76c5846e06f5466c99ec91180"
server_key_iv: "c9b1bb5a666fbbdeb1155d4e1ff6b650"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.223770 23500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "69a200534a6640fbb8b6e74a7cc893d5"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "376104b76c5846e06f5466c99ec91180"
server_key_iv: "c9b1bb5a666fbbdeb1155d4e1ff6b650"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.229161 23500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:10.255209 23523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.257292 23500 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.001s
I20260808 18:41:10.257464 23500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "69a200534a6640fbb8b6e74a7cc893d5"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "376104b76c5846e06f5466c99ec91180"
server_key_iv: "c9b1bb5a666fbbdeb1155d4e1ff6b650"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.257648 23500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:10.284401 23500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:10.288071 23500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:10.288275 23500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:10.288945 23500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:10.289994 23500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:10.290055 23500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.290112 23500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:10.290143 23500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.301134 23500 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:33353
I20260808 18:41:10.302346 23500 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:41:10.308995 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 23500
I20260808 18:41:10.309135 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:41:10.309464 4343 external_mini_cluster.cc:1428] Setting key 1d4b2e9d46726cca457e4ce3b4e33baa
I20260808 18:41:10.314580 23720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:33353 every 8 connection(s)
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:10.344854 23496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:10.319711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:43345 (local address 127.4.61.254:45719)
0808 18:41:10.319846 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:10.319851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:10.322819 (+ 2968us) server_negotiation.cc:407] Connection header received
0808 18:41:10.326465 (+ 3646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:10.326469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:10.326532 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:10.326595 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:10.331911 (+ 5316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.332718 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.334460 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.334768 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.334844 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:10.340502 (+ 5658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:10.340506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:10.340509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:10.340538 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:10.342221 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:10.342866 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:10.342870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:10.342871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:10.342960 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:10.343405 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:10.343409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:10.343410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:10.343643 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:10.343725 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:10.344503 (+ 778us) server_negotiation.cc:299] Negotiation successful
0808 18:41:10.344648 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:41:10.346859 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:10.318375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.194:43345)
0808 18:41:10.322645 (+ 4270us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:10.322707 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:10.323772 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:10.327059 (+ 3287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:10.327069 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:10.327452 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:10.328158 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:10.328178 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.332879 (+ 4701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.332882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:10.334282 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:10.334294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.335059 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.335063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:10.335260 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:10.338568 (+ 3308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:10.338592 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:10.340292 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:10.342385 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:10.342391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:10.342409 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:10.342749 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:10.343076 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:10.343079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:10.343081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:10.343275 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:10.343804 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:10.343811 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:10.344175 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 18:41:10.345347 (+ 1172us) client_negotiation.cc:240] Negotiation successful
0808 18:41:10.345723 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4011,"thread_start_us":153,"threads_started":1}
I20260808 18:41:10.356098 23721 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:10.356392 23721 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:10.357056 23721 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:10.358539 23163 ts_manager.cc:194] Registered new tserver with Master: 69a200534a6640fbb8b6e74a7cc893d5 (127.4.61.194:33353)
I20260808 18:41:10.359334 23163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:43345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:41:10.367290 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214469, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
W20260808 18:41:10.530468 23730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:10.530763 23730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:10.530838 23730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:10.535064 23730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:10.535140 23730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:10.535240 23730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:10.541272 23730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:10.542587 23730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:10.543696 23730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:10.555267 23743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:10.555267 23737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:10.555814 23739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:10.556623 23730 server_base.cc:1034] running on GCE node
I20260808 18:41:10.557124 23730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:10.557838 23730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:10.559001 23730 hybrid_clock.cc:648] HybridClock initialized: now 1786214470558972 us; error 40 us; skew 500 ppm
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:10.562465 23730 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:10.563517 23730 webserver.cc:460] Webserver started at http://127.4.61.195:45839/ using document root <none> and password file <none>
I20260808 18:41:10.564098 23730 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:10.564167 23730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:10.564401 23730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:10.578253 23730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "57744324ba244a71a0e397a5c8fd910e"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "65cc87cc8bc5a32125f12ad43e9b10c2"
server_key_iv: "e885e93b7154b43d2ce4a7ff53ca60c9"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.579169 23730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "57744324ba244a71a0e397a5c8fd910e"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "65cc87cc8bc5a32125f12ad43e9b10c2"
server_key_iv: "e885e93b7154b43d2ce4a7ff53ca60c9"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.586242 23730 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260808 18:41:10.606045 23751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.607818 23730 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 18:41:10.607983 23730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "57744324ba244a71a0e397a5c8fd910e"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "65cc87cc8bc5a32125f12ad43e9b10c2"
server_key_iv: "e885e93b7154b43d2ce4a7ff53ca60c9"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:10.608144 23730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:10.645560 23730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:10.649240 23730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:10.649430 23730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:10.650123 23730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:10.651237 23730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:10.651301 23730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.651352 23730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:10.651379 23730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:10.676050 23730 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45677
I20260808 18:41:10.677340 23730 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:10.678809 23947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45677 every 8 connection(s)
I20260808 18:41:10.680505 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 23730
I20260808 18:41:10.680647 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:41:10.681010 4343 external_mini_cluster.cc:1428] Setting key 4fe6ade6a1ef890b0fdb00fe14b13ae8
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:10.697746 23496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:10.682354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:60199 (local address 127.4.61.254:45719)
0808 18:41:10.682523 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:10.682528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:10.683585 (+ 1057us) server_negotiation.cc:407] Connection header received
0808 18:41:10.685166 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:10.685170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:10.685227 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:10.685320 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:10.687091 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.687926 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.689654 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.690009 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.690117 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:10.693583 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:10.693589 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:10.693592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:10.693621 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:10.695483 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:10.696065 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:10.696070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:10.696071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:10.696167 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:10.696535 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:10.696538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:10.696540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:10.696777 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:10.696876 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:10.697449 (+ 573us) server_negotiation.cc:299] Negotiation successful
0808 18:41:10.697571 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 18:41:10.698742 23952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:10.681021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.195:60199)
0808 18:41:10.683429 (+ 2408us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:10.683486 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:10.684918 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:10.685526 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:10.685536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:10.686075 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:10.686929 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:10.686951 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.688066 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.688070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:10.689523 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:10.689535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:10.690162 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:10.690165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:10.690443 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:10.691186 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:10.691207 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:10.693393 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:10.695601 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:10.695607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:10.695623 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:10.695952 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:10.696260 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:10.696263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:10.696265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:10.696435 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:10.696877 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:10.696884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:10.697176 (+ 292us) client_negotiation.cc:769] Sending connection context
0808 18:41:10.697361 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 18:41:10.697659 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2142,"thread_start_us":240,"threads_started":1}
I20260808 18:41:10.699978 23949 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:10.700237 23949 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:10.700910 23949 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:10.702090 23163 ts_manager.cc:194] Registered new tserver with Master: 57744324ba244a71a0e397a5c8fd910e (127.4.61.195:45677)
I20260808 18:41:10.702840 23163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:60199
I20260808 18:41:10.708202 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:41:10.709035 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 23290
I20260808 18:41:10.755359 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 23500
I20260808 18:41:10.781893 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 23730
I20260808 18:41:10.799247 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 23110
I20260808 18:41:10.814797 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45719
--webserver_interface=127.4.61.254
--webserver_port=40535
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:45719
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:10.928830 23954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:10.929205 23954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:10.929283 23954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:10.935038 23954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:10.935122 23954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:10.935146 23954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:10.935168 23954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:10.935187 23954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:10.941588 23954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:45719
--ranger_config_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:10.942777 23954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:10.943782 23954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:10.952052 23962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:10.952054 23961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:10.952265 23954 server_base.cc:1034] running on GCE node
W20260808 18:41:10.952054 23968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:10.952910 23954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:10.953989 23954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:10.955140 23954 hybrid_clock.cc:648] HybridClock initialized: now 1786214470955118 us; error 32 us; skew 500 ppm
Aug 08 18:41:10 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:10.957904 23954 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:10.958915 23954 webserver.cc:460] Webserver started at http://127.4.61.254:40535/ using document root <none> and password file <none>
I20260808 18:41:10.959465 23954 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:10.959539 23954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214470, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:11.037480 23954 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.002s
I20260808 18:41:11.039984 23983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.041440 23954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 18:41:11.041580 23954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "415df95769d94b3eb47dd167c0c52ed9"
format_stamp: "Formatted at 2026-08-08 18:41:08 on dist-test-slave-fgb3"
server_key: "4935cfc2f947809fdd7d9fe17a242932"
server_key_iv: "ba724e791d397151b9565496267812c8"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:11.042177 23954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:11.053869 23954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:11.056730 23954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:11.056923 23954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:11.064424 23954 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:45719
I20260808 18:41:11.064508 24079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:45719 every 8 connection(s)
I20260808 18:41:11.065573 23954 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:11.068437 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 23954
I20260808 18:41:11.068876 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:42065
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:45719
--webserver_port=42357
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:11.071905 24080 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:41:11.074303 24080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Bootstrap starting.
I20260808 18:41:11.097555 24080 log.cc:824] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:11.106997 24080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:41:11.107514 24080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Bootstrap complete.
I20260808 18:41:11.113389 24080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:11.113971 24080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415df95769d94b3eb47dd167c0c52ed9, State: Initialized, Role: FOLLOWER
I20260808 18:41:11.114611 24080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:11.114789 24080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:11.114868 24080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:11.114970 24080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:41:11.117695 24080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:11.118129 24080 leader_election.cc:302] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 415df95769d94b3eb47dd167c0c52ed9; no voters:
I20260808 18:41:11.118572 24080 leader_election.cc:288] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 18:41:11.118815 24085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 18:41:11.119138 24085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [term 2 LEADER]: Becoming Leader. State: Replica: 415df95769d94b3eb47dd167c0c52ed9, State: Running, Role: LEADER
I20260808 18:41:11.119552 24085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } }
I20260808 18:41:11.120060 24080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:11.120760 24085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "415df95769d94b3eb47dd167c0c52ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } } }
I20260808 18:41:11.120955 24085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:11.121229 24085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 415df95769d94b3eb47dd167c0c52ed9. Latest consensus state: current_term: 2 leader_uuid: "415df95769d94b3eb47dd167c0c52ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415df95769d94b3eb47dd167c0c52ed9" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 45719 } } }
I20260808 18:41:11.121387 24085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:11.121721 24098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:11.125253 24098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:11.125802 24080 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 18:41:11.126075 24098 catalog_manager.cc:1259] Loaded cluster ID: b44ac065ebe94104adab177dce6c543f
I20260808 18:41:11.126176 24098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:11.128738 24098 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:11.129570 24098 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Loaded TSK: 0
I20260808 18:41:11.130899 24098 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:41:11.233608 24083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:11.233978 24083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:11.234059 24083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:11.240437 24083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:11.240535 24083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:11.240640 24083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:11.248250 24083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:42065
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=42357
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:11.249603 24083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:11.250960 24083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:41:11.264791 24083 server_base.cc:1034] running on GCE node
W20260808 18:41:11.265218 24140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.265327 24145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.266494 24143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:11.267017 24083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:11.267882 24083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:11.269061 24083 hybrid_clock.cc:648] HybridClock initialized: now 1786214471269029 us; error 52 us; skew 500 ppm
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:11.272828 24083 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:11.274128 24083 webserver.cc:460] Webserver started at http://127.4.61.193:42357/ using document root <none> and password file <none>
I20260808 18:41:11.275019 24083 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:11.275202 24083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:11.300719 24083 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 18:41:11.304073 24161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.305902 24083 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 18:41:11.306064 24083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "a38c358f96574c5692bf537db1450183"
format_stamp: "Formatted at 2026-08-08 18:41:09 on dist-test-slave-fgb3"
server_key: "24b5f92ca8ffcb71616fb5508fc04d54"
server_key_iv: "4dfbf602c57fe10ec9029a746392a885"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:11.306919 24083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:11.334061 24083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:11.339536 24083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:11.339844 24083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:11.340575 24083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:11.341742 24083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:11.341873 24083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.342002 24083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:11.342079 24083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.355279 24083 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:42065
I20260808 18:41:11.355755 24341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:42065 every 8 connection(s)
I20260808 18:41:11.356624 24083 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:11.364837 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 24083
I20260808 18:41:11.365433 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:33353
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:45719
--webserver_port=43895
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:11.376905 24347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.359266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.193:45761)
0808 18:41:11.360180 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:11.360230 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:11.361093 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:11.362295 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:11.362304 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:11.362689 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:11.363222 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.363240 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.364565 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.364569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.365907 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.365921 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.367482 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.367487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.367678 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.368386 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:11.368405 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:11.370042 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:11.372726 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.372734 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.372750 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.373140 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.373638 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.373642 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.373644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.373844 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.374786 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:11.374793 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:11.375113 (+ 320us) client_negotiation.cc:769] Sending connection context
0808 18:41:11.375344 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 18:41:11.375717 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":125,"threads_started":1}
I20260808 18:41:11.379141 24346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.359154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:45761 (local address 127.4.61.254:45719)
0808 18:41:11.359864 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:11.359890 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:11.360369 (+ 479us) server_negotiation.cc:407] Connection header received
0808 18:41:11.361547 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:11.361557 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:11.361870 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:11.362192 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:11.363406 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.364406 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.366263 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.367033 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.367217 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.370285 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:11.370294 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:11.370338 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:11.370379 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:11.372560 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.373323 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.373330 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.373337 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.373505 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.373981 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.373985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.373988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.374580 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:11.374723 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:11.377682 (+ 2959us) server_negotiation.cc:299] Negotiation successful
0808 18:41:11.378062 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":142,"threads_started":1}
I20260808 18:41:11.382807 24343 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:11.383080 24343 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.383684 24343 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.386365 24343 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 18:41:11.386523 24343 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.386754 24343 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:11.387961 24343 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.388177 24343 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.389127 24343 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:41:11.542797 24348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:11.543169 24348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:11.543265 24348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:11.549168 24348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:11.549260 24348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:11.549368 24348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:11.557219 24348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:33353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=43895
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:11.558768 24348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:11.560189 24348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:11.571635 24363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.571621 24361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.571625 24360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:11.572149 24348 server_base.cc:1034] running on GCE node
I20260808 18:41:11.572621 24348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:11.573431 24348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:11.574607 24348 hybrid_clock.cc:648] HybridClock initialized: now 1786214471574574 us; error 49 us; skew 500 ppm
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:11.578140 24348 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:11.579321 24348 webserver.cc:460] Webserver started at http://127.4.61.194:43895/ using document root <none> and password file <none>
I20260808 18:41:11.580111 24348 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:11.580281 24348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:11.598788 24348 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:11.602123 24378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.604079 24348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 18:41:11.604208 24348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "69a200534a6640fbb8b6e74a7cc893d5"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "376104b76c5846e06f5466c99ec91180"
server_key_iv: "c9b1bb5a666fbbdeb1155d4e1ff6b650"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:11.604821 24348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:11.619273 24348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:11.622432 24348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:11.622613 24348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:11.623217 24348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:11.624087 24348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:11.624136 24348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.624191 24348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:11.624220 24348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.634271 24348 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:33353
I20260808 18:41:11.634353 24553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:33353 every 8 connection(s)
I20260808 18:41:11.635624 24348 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:41:11.640543 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 24348
I20260808 18:41:11.641001 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.61.212:36705/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:45677
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:45719
--webserver_port=45839
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:11.655380 24346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.637541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:57263 (local address 127.4.61.254:45719)
0808 18:41:11.637675 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:11.637679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:11.639311 (+ 1632us) server_negotiation.cc:407] Connection header received
0808 18:41:11.643029 (+ 3718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:11.643033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:11.643101 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:11.643165 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:11.644986 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.645824 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.647379 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.647627 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.647744 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.651024 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:11.651028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:11.651031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:11.651064 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:11.652973 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.653678 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.653682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.653684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.653783 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.654154 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.654157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.654158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.654409 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:11.654501 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:11.655056 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 18:41:11.655197 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:41:11.656479 24560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.637990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.194:57263)
0808 18:41:11.639121 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:11.639161 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:11.640083 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:11.643663 (+ 3580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:11.643675 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:11.644060 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:11.644803 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.644827 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.646036 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.646039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.647194 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.647207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.647934 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.647938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.648144 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.648873 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:11.648894 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:11.650798 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:11.653132 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.653139 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.653159 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.653551 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.653890 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.653892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.653894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.654039 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.654511 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:11.654519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:11.654796 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 18:41:11.654976 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 18:41:11.655322 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":941,"thread_start_us":155,"threads_started":1}
I20260808 18:41:11.657699 24556 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:11.657953 24556 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.658571 24556 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.660394 24556 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 18:41:11.660558 24556 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.660761 24556 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:11.661684 24556 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.661893 24556 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.662735 24556 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:41:11.788197 24561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:11.788509 24561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:11.788586 24561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:11.792837 24561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:11.792901 24561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:11.792982 24561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:11.799490 24561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.61.212:36705/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:45677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=45839
--tserver_master_addrs=127.4.61.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:11.800895 24561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:11.802260 24561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:11.813901 24571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.813885 24575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:11.813874 24578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:11.819701 24561 server_base.cc:1034] running on GCE node
I20260808 18:41:11.820323 24561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:11.821290 24561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:11.824590 24561 hybrid_clock.cc:648] HybridClock initialized: now 1786214471824460 us; error 138 us; skew 500 ppm
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:11.828472 24561 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:11.829676 24561 webserver.cc:460] Webserver started at http://127.4.61.195:45839/ using document root <none> and password file <none>
I20260808 18:41:11.830439 24561 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:11.830543 24561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:11.850171 24561 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:41:11.853848 24594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.855268 24561 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 18:41:11.855464 24561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "57744324ba244a71a0e397a5c8fd910e"
format_stamp: "Formatted at 2026-08-08 18:41:10 on dist-test-slave-fgb3"
server_key: "65cc87cc8bc5a32125f12ad43e9b10c2"
server_key_iv: "e885e93b7154b43d2ce4a7ff53ca60c9"
server_key_version: "kuduclusterkey@0"
I20260808 18:41:11.856240 24561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:11.872011 24561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:11.875574 24561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:11.875792 24561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:11.876557 24561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:11.877657 24561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:11.877740 24561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.877812 24561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:11.877842 24561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:11.887527 24561 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45677
I20260808 18:41:11.887796 24784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45677 every 8 connection(s)
I20260808 18:41:11.888622 24561 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:11.891228 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 24561
Aug 08 18:41:11 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214471, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:11.904054 24791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.891905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55190 (local address 127.4.61.254:45719)
0808 18:41:11.892128 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:11.892137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:11.893601 (+ 1464us) server_negotiation.cc:407] Connection header received
0808 18:41:11.893721 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:11.893724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:11.893778 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:11.893880 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:11.894781 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.895670 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.896842 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.897196 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.898446 (+ 1250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.899911 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:11.899914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:11.899917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:11.899951 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:11.901612 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.902092 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.902095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.902097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.902180 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.902527 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.902530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.902532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.902754 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:11.902948 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:11.903743 (+ 795us) server_negotiation.cc:299] Negotiation successful
0808 18:41:11.903867 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260808 18:41:11.904616 24346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.890533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47309 (local address 127.4.61.254:45719)
0808 18:41:11.890690 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:11.890694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:11.892305 (+ 1611us) server_negotiation.cc:407] Connection header received
0808 18:41:11.893240 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:11.893243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:11.893298 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:11.893372 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:11.894895 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.895463 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.897603 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.897819 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.897902 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.900640 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:11.900644 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:11.900646 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:11.900698 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:11.902224 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.902824 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.902827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.902829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.902996 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:11.903399 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:11.903402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:11.903404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:11.903601 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:11.903671 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:11.904366 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 18:41:11.904473 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":64}
I20260808 18:41:11.906138 24790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:11.890910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:45719 (local address 127.4.61.195:47309)
0808 18:41:11.892154 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:11.892209 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:11.893011 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:11.893688 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:11.893697 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:11.894039 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:11.894756 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.894776 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.895585 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.895589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.897493 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:11.897504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:11.897974 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:11.897979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:11.898147 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:11.898768 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:11.898789 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:11.900450 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:11.902355 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.902361 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.902379 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.902714 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.903106 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:11.903108 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:11.903110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:11.903293 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:11.903739 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:11.903745 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:11.904089 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 18:41:11.904798 (+ 709us) client_negotiation.cc:240] Negotiation successful
0808 18:41:11.905169 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":274,"threads_started":1}
I20260808 18:41:11.907240 24785 heartbeater.cc:347] Connected to a master server at 127.4.61.254:45719
I20260808 18:41:11.907457 24785 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.907912 24785 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.909492 24785 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:45719 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 18:41:11.909632 24785 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.909780 24785 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:11.910560 24785 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:11.910708 24785 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
W20260808 18:41:11.911393 24785 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 18:41:12 dist-test-slave-fgb3 krb5kdc[22403](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786214472, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:12.389375 24343 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:12.389715 24343 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:12.391032 24019 ts_manager.cc:194] Registered new tserver with Master: a38c358f96574c5692bf537db1450183 (127.4.61.193:42065)
I20260808 18:41:12.392851 24019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:45761
I20260808 18:41:12.663002 24556 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:12.663326 24556 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:12.665431 24019 ts_manager.cc:194] Registered new tserver with Master: 69a200534a6640fbb8b6e74a7cc893d5 (127.4.61.194:33353)
I20260808 18:41:12.666210 24019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:57263
Aug 08 18:41:12 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214472, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
I20260808 18:41:12.911604 24785 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:12.911947 24785 heartbeater.cc:511] Master 127.4.61.254:45719 requested a full tablet report, sending...
I20260808 18:41:12.912770 24019 ts_manager.cc:194] Registered new tserver with Master: 57744324ba244a71a0e397a5c8fd910e (127.4.61.195:45677)
I20260808 18:41:12.913568 24019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:47309
I20260808 18:41:12.917903 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:41:12.936558 24821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.919869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55198 (local address 127.4.61.254:45719)
0808 18:41:12.920215 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:12.920220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:12.926807 (+ 6587us) server_negotiation.cc:407] Connection header received
0808 18:41:12.926863 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:12.926866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:12.926921 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:12.927005 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:12.927975 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.928806 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.930024 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.930411 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.930510 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.932318 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:12.932322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:12.932325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:12.932355 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:12.934122 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:12.934683 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:12.934686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:12.934688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:12.934786 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:12.935105 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:12.935109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:12.935111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:12.935349 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:12.935497 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:12.936226 (+ 729us) server_negotiation.cc:299] Negotiation successful
0808 18:41:12.936357 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":123,"threads_started":1}
I20260808 18:41:12.940862 24019 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55198:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:41:12.946218 24019 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:41:12.987051 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.972080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45677 (local address 127.0.0.1:45352)
0808 18:41:12.975217 (+ 3137us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:12.975231 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:12.975320 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:12.977065 (+ 1745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:12.977072 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:12.977097 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:12.977239 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.977246 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.978755 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.978759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.980930 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.980942 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.986484 (+ 5542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.986487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.986602 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.986644 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 18:41:12.986761 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 18:41:12.986893 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3075,"thread_start_us":93,"threads_started":1}
I20260808 18:41:12.987381 24835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.970399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:33353 (local address 127.0.0.1:37132)
0808 18:41:12.974573 (+ 4174us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:12.974637 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:12.974777 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:12.983121 (+ 8344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:12.983125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:12.983142 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:12.983241 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.983247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.984604 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.984607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.985774 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.985786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.986990 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.986994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.987091 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.987113 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:41:12.987181 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:41:12.987249 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3971,"mutex_wait_us":26,"thread_start_us":116,"threads_started":1}
I20260808 18:41:12.987914 24834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.970518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37132 (local address 127.4.61.194:33353)
0808 18:41:12.982524 (+ 12006us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:12.982532 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:12.982557 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:41:12.982631 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:12.982636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:12.982831 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:12.982976 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:12.983371 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.984466 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.985908 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.986687 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.986798 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.986930 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:12.987664 (+ 734us) server_negotiation.cc:299] Negotiation successful
0808 18:41:12.987777 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11890,"thread_start_us":114,"threads_started":1}
I20260808 18:41:12.989285 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.972392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.4.61.195:45677)
0808 18:41:12.975078 (+ 2686us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:12.975086 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:12.976402 (+ 1316us) server_negotiation.cc:407] Connection header received
0808 18:41:12.976488 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:12.976493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:12.976718 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:12.976869 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:12.977372 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.978620 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.983525 (+ 4905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.986104 (+ 2579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.986213 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.986414 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:12.989039 (+ 2625us) server_negotiation.cc:299] Negotiation successful
0808 18:41:12.989146 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2572,"thread_start_us":105,"threads_started":1}
I20260808 18:41:12.991403 24830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.973511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42065 (local address 127.0.0.1:50490)
0808 18:41:12.981160 (+ 7649us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:12.981174 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:12.981257 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:12.982008 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:12.982011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:12.982030 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:12.982115 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.982121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.984827 (+ 2706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.984830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.987727 (+ 2897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:12.987739 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.990974 (+ 3235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.990977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:12.991072 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.991099 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 18:41:12.991174 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 18:41:12.991251 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7586,"mutex_wait_us":1703,"thread_start_us":81,"threads_started":1}
I20260808 18:41:12.991266 24455 tablet_service.cc:1467] Processing CreateTablet for tablet 6a551379672e40cd8b7494a6084cc59d (DEFAULT_TABLE table=test-table [id=e1976ac2e6e44b868662c2f144be72ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:12.991915 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:12.973911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50490 (local address 127.4.61.193:42065)
0808 18:41:12.976324 (+ 2413us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:12.976345 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:12.981353 (+ 5008us) server_negotiation.cc:407] Connection header received
0808 18:41:12.981451 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:12.981457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:12.981690 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:12.981848 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:12.982245 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.983372 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.987869 (+ 4497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:12.988712 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:12.988817 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:12.988961 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:12.991652 (+ 2691us) server_negotiation.cc:299] Negotiation successful
0808 18:41:12.991769 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1545,"thread_start_us":92,"threads_started":1}
I20260808 18:41:12.992542 24455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a551379672e40cd8b7494a6084cc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:12.995074 24229 tablet_service.cc:1467] Processing CreateTablet for tablet 6a551379672e40cd8b7494a6084cc59d (DEFAULT_TABLE table=test-table [id=e1976ac2e6e44b868662c2f144be72ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:12.996197 24229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a551379672e40cd8b7494a6084cc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:12.995958 24670 tablet_service.cc:1467] Processing CreateTablet for tablet 6a551379672e40cd8b7494a6084cc59d (DEFAULT_TABLE table=test-table [id=e1976ac2e6e44b868662c2f144be72ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:12.996961 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a551379672e40cd8b7494a6084cc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:13.003166 24842 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Bootstrap starting.
I20260808 18:41:13.006397 24842 tablet_bootstrap.cc:654] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:13.007977 24842 log.cc:824] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:13.010699 24845 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Bootstrap starting.
I20260808 18:41:13.010977 24842 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: No bootstrap required, opened a new log
I20260808 18:41:13.011181 24842 ts_tablet_manager.cc:1397] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.006s
I20260808 18:41:13.013882 24845 tablet_bootstrap.cc:654] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:13.015266 24845 log.cc:824] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:13.016111 24843 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Bootstrap starting.
I20260808 18:41:13.019287 24843 tablet_bootstrap.cc:654] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:13.019956 24842 raft_consensus.cc:348] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.020364 24842 raft_consensus.cc:374] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:13.020468 24842 raft_consensus.cc:729] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a200534a6640fbb8b6e74a7cc893d5, State: Initialized, Role: FOLLOWER
I20260808 18:41:13.020763 24843 log.cc:824] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:13.021528 24842 consensus_queue.cc:260] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.022899 24842 ts_tablet_manager.cc:1428] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Time spent starting tablet: real 0.012s user 0.007s sys 0.002s
I20260808 18:41:13.023062 24845 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: No bootstrap required, opened a new log
I20260808 18:41:13.023277 24845 ts_tablet_manager.cc:1397] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s
I20260808 18:41:13.023340 24556 heartbeater.cc:503] Master 127.4.61.254:45719 was elected leader, sending a full tablet report...
I20260808 18:41:13.029495 24845 raft_consensus.cc:348] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.029788 24845 raft_consensus.cc:374] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:13.029840 24845 raft_consensus.cc:729] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a38c358f96574c5692bf537db1450183, State: Initialized, Role: FOLLOWER
I20260808 18:41:13.030299 24845 consensus_queue.cc:260] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.032100 24845 ts_tablet_manager.cc:1428] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Time spent starting tablet: real 0.009s user 0.003s sys 0.006s
I20260808 18:41:13.032478 24343 heartbeater.cc:503] Master 127.4.61.254:45719 was elected leader, sending a full tablet report...
I20260808 18:41:13.044934 24843 tablet_bootstrap.cc:492] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: No bootstrap required, opened a new log
I20260808 18:41:13.045203 24843 ts_tablet_manager.cc:1397] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
I20260808 18:41:13.050060 24843 raft_consensus.cc:348] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.050455 24843 raft_consensus.cc:374] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:13.050513 24843 raft_consensus.cc:729] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57744324ba244a71a0e397a5c8fd910e, State: Initialized, Role: FOLLOWER
I20260808 18:41:13.051059 24843 consensus_queue.cc:260] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.052167 24785 heartbeater.cc:503] Master 127.4.61.254:45719 was elected leader, sending a full tablet report...
I20260808 18:41:13.052649 24843 ts_tablet_manager.cc:1428] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
Aug 08 18:41:13 dist-test-slave-fgb3 krb5kdc[22403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214472, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for HTTP/127.4.61.212@KRBTEST.COM
W20260808 18:41:13.109211 24345 tablet.cc:2369] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:41:13.137943 24559 tablet.cc:2369] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:41:13.141340 24788 tablet.cc:2369] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:13.155633 24858 raft_consensus.cc:482] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:13.155923 24858 raft_consensus.cc:504] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.157507 24858 leader_election.cc:288] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a200534a6640fbb8b6e74a7cc893d5 (127.4.61.194:33353), a38c358f96574c5692bf537db1450183 (127.4.61.193:42065)
I20260808 18:41:13.164557 24834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.159238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:57055 (local address 127.4.61.194:33353)
0808 18:41:13.159387 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:13.159392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:13.159411 (+ 19us) server_negotiation.cc:407] Connection header received
0808 18:41:13.159614 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:13.159618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:13.159669 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:13.159715 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:13.160405 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.161167 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.163074 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.163682 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.163785 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:13.163841 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:13.164314 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 18:41:13.164405 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:41:13.165086 24860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.157925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:33353 (local address 127.4.61.195:57055)
0808 18:41:13.159143 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:13.159160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:13.159472 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:13.159856 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:13.159859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:13.159878 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:13.160263 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:13.160272 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.161334 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.161337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:13.162920 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:13.162934 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.163941 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.163944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:13.164145 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:13.164174 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 18:41:13.164799 (+ 625us) client_negotiation.cc:240] Negotiation successful
0808 18:41:13.164885 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"thread_start_us":287,"threads_started":1}
I20260808 18:41:13.166174 24458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a551379672e40cd8b7494a6084cc59d" candidate_uuid: "57744324ba244a71a0e397a5c8fd910e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a200534a6640fbb8b6e74a7cc893d5" is_pre_election: true
I20260808 18:41:13.166615 24458 raft_consensus.cc:2454] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57744324ba244a71a0e397a5c8fd910e in term 0.
I20260808 18:41:13.167528 24600 leader_election.cc:302] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57744324ba244a71a0e397a5c8fd910e, 69a200534a6640fbb8b6e74a7cc893d5; no voters:
I20260808 18:41:13.167934 24858 raft_consensus.cc:2781] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:13.168056 24858 raft_consensus.cc:482] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:13.168108 24858 raft_consensus.cc:3037] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:13.170156 24858 raft_consensus.cc:504] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.170672 24858 leader_election.cc:288] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [CANDIDATE]: Term 1 election: Requested vote from peers 69a200534a6640fbb8b6e74a7cc893d5 (127.4.61.194:33353), a38c358f96574c5692bf537db1450183 (127.4.61.193:42065)
I20260808 18:41:13.171262 24458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a551379672e40cd8b7494a6084cc59d" candidate_uuid: "57744324ba244a71a0e397a5c8fd910e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a200534a6640fbb8b6e74a7cc893d5"
I20260808 18:41:13.171415 24458 raft_consensus.cc:3037] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:13.173301 24458 raft_consensus.cc:2454] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57744324ba244a71a0e397a5c8fd910e in term 1.
I20260808 18:41:13.173715 24600 leader_election.cc:302] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57744324ba244a71a0e397a5c8fd910e, 69a200534a6640fbb8b6e74a7cc893d5; no voters:
I20260808 18:41:13.173919 24858 raft_consensus.cc:2781] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:13.174149 24858 raft_consensus.cc:686] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 1 LEADER]: Becoming Leader. State: Replica: 57744324ba244a71a0e397a5c8fd910e, State: Running, Role: LEADER
I20260808 18:41:13.174592 24858 consensus_queue.cc:237] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } }
I20260808 18:41:13.178354 24019 catalog_manager.cc:5495] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e reported cstate change: term changed from 0 to 1, leader changed from <none> to 57744324ba244a71a0e397a5c8fd910e (127.4.61.195). New cstate: current_term: 1 leader_uuid: "57744324ba244a71a0e397a5c8fd910e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57744324ba244a71a0e397a5c8fd910e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 } health_report { overall_health: UNKNOWN } } }
I20260808 18:41:13.179313 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.159401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:60673 (local address 127.4.61.193:42065)
0808 18:41:13.159524 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:13.159529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:13.174873 (+ 15344us) server_negotiation.cc:407] Connection header received
0808 18:41:13.175113 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:13.175116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:13.175174 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:13.175222 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:13.175863 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.176660 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.178023 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.178591 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.178686 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:13.178757 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:13.179102 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 18:41:13.179184 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:41:13.179751 24862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.158599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42065 (local address 127.4.61.195:60673)
0808 18:41:13.174532 (+ 15933us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:13.174550 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:13.174974 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:13.175444 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:13.175447 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:13.175495 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:13.175670 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:13.175679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.176814 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.176817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:13.177850 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:13.177862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.178857 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.178861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:13.178959 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:13.178984 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:41:13.179519 (+ 535us) client_negotiation.cc:240] Negotiation successful
0808 18:41:13.179603 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15842,"thread_start_us":161,"threads_started":1}
I20260808 18:41:13.180493 24255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a551379672e40cd8b7494a6084cc59d" candidate_uuid: "57744324ba244a71a0e397a5c8fd910e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a38c358f96574c5692bf537db1450183" is_pre_election: true
I20260808 18:41:13.180845 24255 raft_consensus.cc:2454] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57744324ba244a71a0e397a5c8fd910e in term 0.
I20260808 18:41:13.181440 24248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a551379672e40cd8b7494a6084cc59d" candidate_uuid: "57744324ba244a71a0e397a5c8fd910e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a38c358f96574c5692bf537db1450183"
I20260808 18:41:13.181565 24248 raft_consensus.cc:3037] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:13.183650 24248 raft_consensus.cc:2454] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57744324ba244a71a0e397a5c8fd910e in term 1.
I20260808 18:41:13.215536 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.209477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45368 (local address 127.4.61.195:45677)
0808 18:41:13.209603 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:13.209608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:13.209622 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:41:13.209716 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:13.209719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:13.209804 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:13.209907 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:41:13.210221 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.211089 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.212657 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:13.213021 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:13.213114 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:13.213615 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:41:13.214273 (+ 658us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:41:13.214515 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:13.215166 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 18:41:13.215249 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 18:41:13.223978 24248 raft_consensus.cc:1261] T 6a551379672e40cd8b7494a6084cc59d P a38c358f96574c5692bf537db1450183 [term 1 FOLLOWER]: Refusing update from remote peer 57744324ba244a71a0e397a5c8fd910e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:13.224858 24863 consensus_queue.cc:1035] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a38c358f96574c5692bf537db1450183" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 42065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:13.225610 24458 raft_consensus.cc:1261] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 1 FOLLOWER]: Refusing update from remote peer 57744324ba244a71a0e397a5c8fd910e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:13.231318 24863 consensus_queue.cc:1035] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a200534a6640fbb8b6e74a7cc893d5" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:13.248560 24868 mvcc.cc:205] Tried to move back new op lower bound from 7316334482315653120 to 7316334482127200256. Current Snapshot: MvccSnapshot[applied={T|T < 7316334482315653120 or (T in {7316334482315653120})}]
I20260808 18:41:13.250890 24876 mvcc.cc:205] Tried to move back new op lower bound from 7316334482315653120 to 7316334482127200256. Current Snapshot: MvccSnapshot[applied={T|T < 7316334482315653120}]
I20260808 18:41:13.253208 24019 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:13.253415 24019 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:13.256505 24019 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 415df95769d94b3eb47dd167c0c52ed9: Sending DeleteTablet for 3 replicas of tablet 6a551379672e40cd8b7494a6084cc59d
I20260808 18:41:13.257542 24455 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a551379672e40cd8b7494a6084cc59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:13 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:37132
I20260808 18:41:13.259256 24670 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a551379672e40cd8b7494a6084cc59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:13 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45352
I20260808 18:41:13.259325 24229 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a551379672e40cd8b7494a6084cc59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:13 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:50490
I20260808 18:41:13.260376 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 24083
I20260808 18:41:13.262043 24885 tablet_replica.cc:330] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: stopping tablet replica
I20260808 18:41:13.262472 24885 raft_consensus.cc:2229] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:41:13.262816 24885 raft_consensus.cc:2258] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:13.275703 24885 ts_tablet_manager.cc:1905] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:13.279110 24884 tablet_replica.cc:330] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: stopping tablet replica
I20260808 18:41:13.279650 24884 raft_consensus.cc:2229] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:13.280045 24884 raft_consensus.cc:2258] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:13.281662 24885 ts_tablet_manager.cc:1918] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:13.281785 24885 log.cc:1196] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/6a551379672e40cd8b7494a6084cc59d
I20260808 18:41:13.282158 24885 ts_tablet_manager.cc:1939] T 6a551379672e40cd8b7494a6084cc59d P 57744324ba244a71a0e397a5c8fd910e: Deleting consensus metadata
I20260808 18:41:13.283630 23988 catalog_manager.cc:4841] TS 57744324ba244a71a0e397a5c8fd910e (127.4.61.195:45677): tablet 6a551379672e40cd8b7494a6084cc59d (table test-table [id=e1976ac2e6e44b868662c2f144be72ce]) successfully deleted
I20260808 18:41:13.300211 24884 ts_tablet_manager.cc:1905] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:13.303452 24884 ts_tablet_manager.cc:1918] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:13.303591 24884 log.cc:1196] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/6a551379672e40cd8b7494a6084cc59d
I20260808 18:41:13.303951 24884 ts_tablet_manager.cc:1939] T 6a551379672e40cd8b7494a6084cc59d P 69a200534a6640fbb8b6e74a7cc893d5: Deleting consensus metadata
I20260808 18:41:13.305603 23988 catalog_manager.cc:4841] TS 69a200534a6640fbb8b6e74a7cc893d5 (127.4.61.194:33353): tablet 6a551379672e40cd8b7494a6084cc59d (table test-table [id=e1976ac2e6e44b868662c2f144be72ce]) successfully deleted
W20260808 18:41:13.306116 23988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:42065 (error 108)
I20260808 18:41:13.307662 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 24348
I20260808 18:41:13.307695 24830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:13.307365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:42065 (local address 127.0.0.1:50494)
0808 18:41:13.307517 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:13.307599 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:42065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 18:41:13.327175 23988 catalog_manager.cc:4584] TS a38c358f96574c5692bf537db1450183 (127.4.61.193:42065): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6a551379672e40cd8b7494a6084cc59d: Network error: Client connection negotiation failed: client connection to 127.4.61.193:42065: connect: Connection refused (error 111)
I20260808 18:41:13.335256 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 24561
I20260808 18:41:13.354244 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 23954
I20260808 18:41:13.367769 4343 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 18:41:13.712224 4343 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 18:41:13.712356 4343 mini_ranger.cc:66] Stopping Ranger...
I20260808 18:41:14.057459 4343 mini_ranger.cc:68] Stopped Ranger
2026-08-08 18:41:14.057 UTC [22447] LOG: received smart shutdown request
2026-08-08 18:41:14.062 UTC [22447] LOG: background worker "logical replication launcher" (PID 22462) exited with exit code 1
2026-08-08 18:41:14.062 UTC [22455] LOG: shutting down
2026-08-08 18:41:14.199 UTC [22447] LOG: database system is shut down
2026-08-08T18:41:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49083 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:41:14 dist-test-slave-fgb3 krb5kdc[24902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:41:14 dist-test-slave-fgb3 krb5kdc[24902](info): set up 2 sockets
Aug 08 18:41:14 dist-test-slave-fgb3 krb5kdc[24902](info): commencing operation
krb5kdc: starting...
W20260808 18:41:15.447346 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:41:15 dist-test-slave-fgb3 krb5kdc[24902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:41:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:41:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:41:15.571067 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40639
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:15.684336 24919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:15.684628 24919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:15.684687 24919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:15.688681 24919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:15.688743 24919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:15.688771 24919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:15.688791 24919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:15.688812 24919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:15.694046 24919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:15.695122 24919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:15.696117 24919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:15.704572 24932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:15.704775 24919 server_base.cc:1034] running on GCE node
W20260808 18:41:15.704591 24928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:15.704577 24926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:15.705514 24919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:15.706619 24919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:15.707805 24919 hybrid_clock.cc:648] HybridClock initialized: now 1786214475707777 us; error 38 us; skew 500 ppm
Aug 08 18:41:15 dist-test-slave-fgb3 krb5kdc[24902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:15.710805 24919 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:15.711699 24919 webserver.cc:460] Webserver started at http://127.4.61.254:34123/ using document root <none> and password file <none>
I20260808 18:41:15.712249 24919 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:15.712320 24919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:15.712520 24919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:15.714677 24919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "81d000f3127dc6bd5c3efbc3ed3afd6a"
server_key_iv: "eeae57e69baff91748226af77f52ef4c"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.715232 24919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "81d000f3127dc6bd5c3efbc3ed3afd6a"
server_key_iv: "eeae57e69baff91748226af77f52ef4c"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.718848 24919 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:41:15.721153 24946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:15.722352 24919 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:15.722474 24919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "81d000f3127dc6bd5c3efbc3ed3afd6a"
server_key_iv: "eeae57e69baff91748226af77f52ef4c"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.722564 24919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:15.749392 24919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:15.752532 24919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:15.752718 24919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:15.759614 24919 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40639
I20260808 18:41:15.759651 25030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40639 every 8 connection(s)
I20260808 18:41:15.760581 24919 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:15.763437 25031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:15.767282 25031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:15.768378 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 24919
I20260808 18:41:15.768487 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:41:15.768755 4343 external_mini_cluster.cc:1428] Setting key abfa2ad93857ec977614d1e9c710d740
Aug 08 18:41:15 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.253@KRBTEST.COM" created.
I20260808 18:41:15.782187 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.769545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40712 (local address 127.4.61.254:40639)
0808 18:41:15.770102 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:15.770113 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:15.770208 (+ 95us) server_negotiation.cc:407] Connection header received
0808 18:41:15.771426 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:15.771431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:15.771611 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:15.771767 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:15.772846 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.773735 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.774952 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.775534 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.775719 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:15.777933 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:15.777940 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:15.777953 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:15.777993 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:15.779354 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:15.779765 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:15.779771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:15.779772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:15.779885 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:15.780229 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:15.780232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:15.780234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:15.780696 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:15.780827 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:15.781170 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 18:41:15.781418 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":88,"server-negotiator.queue_time_us":444,"spinlock_wait_cycles":18048,"thread_start_us":176,"threads_started":1}
I20260808 18:41:15.782193 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.769545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40639 (local address 127.0.0.1:40712)
0808 18:41:15.770030 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.770084 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:15.771086 (+ 1002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:15.771824 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:15.771831 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:15.772273 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:15.772653 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:15.772672 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.773888 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.773892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:15.774831 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:15.774841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.775683 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.775686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:15.775794 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:15.776358 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:15.776374 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:15.777787 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:15.779450 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:15.779459 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:15.779467 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:15.779678 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:15.779982 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:15.779984 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:15.779985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:15.780117 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:15.780811 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:15.780817 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:15.780939 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 18:41:15.781077 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 18:41:15.781334 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"spinlock_wait_cycles":896,"thread_start_us":118,"threads_started":1}
I20260808 18:41:15.784420 25031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:15.785065 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.784858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34774)
0808 18:41:15.784954 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.785017 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:41:15.785265 24947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
I20260808 18:41:15.786075 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.785879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34782)
0808 18:41:15.785987 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.786030 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 18:41:15.786216 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40681: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
I20260808 18:41:15.795614 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:40681
--webserver_interface=127.4.61.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:15.835464 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } attempt: 1
I20260808 18:41:15.836323 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.836030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34784)
0808 18:41:15.836180 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.836244 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 18:41:15.837007 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.836797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34798)
0808 18:41:15.836900 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.836948 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 18:41:15.837123 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40681: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
I20260808 18:41:15.905297 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } attempt: 2
I20260808 18:41:15.906217 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.905891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34802)
0808 18:41:15.906049 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.906117 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 18:41:15.906936 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.906714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34806)
0808 18:41:15.906828 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.906876 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 18:41:15.907053 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40681: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40681: connect: Connection refused (error 111)
W20260808 18:41:15.907588 25041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:15.907872 25041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:15.907943 25041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:15.912118 25041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:15.912187 25041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:15.912215 25041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:15.912240 25041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:15.912268 25041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:15.917819 25041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:40681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.61.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:15.919127 25041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:15.920204 25041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:15.928844 25049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:15.928848 25051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:15.928871 25047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:15.929009 25041 server_base.cc:1034] running on GCE node
I20260808 18:41:15.929791 25041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:15.930948 25041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:15.932111 25041 hybrid_clock.cc:648] HybridClock initialized: now 1786214475932077 us; error 46 us; skew 500 ppm
Aug 08 18:41:15 dist-test-slave-fgb3 krb5kdc[24902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:15.934978 25041 init.cc:377] Logged in from keytab as kudu/127.4.61.253@KRBTEST.COM (short username kudu)
I20260808 18:41:15.935861 25041 webserver.cc:460] Webserver started at http://127.4.61.253:46731/ using document root <none> and password file <none>
I20260808 18:41:15.936408 25041 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:15.936474 25041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:15.936683 25041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:15.938782 25041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data/instance:
uuid: "f185f0a213f74e36847c70fe482113b6"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "a66561544270c4ae260fad7f98b5b407"
server_key_iv: "30b6338584e214895441fd8e6d6357ec"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.939335 25041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal/instance:
uuid: "f185f0a213f74e36847c70fe482113b6"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "a66561544270c4ae260fad7f98b5b407"
server_key_iv: "30b6338584e214895441fd8e6d6357ec"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.942987 25041 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:15.945395 25062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:15.946555 25041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:15.946667 25041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "f185f0a213f74e36847c70fe482113b6"
format_stamp: "Formatted at 2026-08-08 18:41:15 on dist-test-slave-fgb3"
server_key: "a66561544270c4ae260fad7f98b5b407"
server_key_iv: "30b6338584e214895441fd8e6d6357ec"
server_key_version: "encryptionkey@0"
I20260808 18:41:15.946760 25041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:15.969646 25041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:15.972863 25041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:15.973053 25041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:15.980995 25041 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.253:40681
I20260808 18:41:15.981009 25159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.253:40681 every 8 connection(s)
I20260808 18:41:15.981999 25041 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
I20260808 18:41:15.982190 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25041
I20260808 18:41:15.982352 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-1/wal/instance
I20260808 18:41:15.982710 4343 external_mini_cluster.cc:1428] Setting key 8c4f4b7e685aee840c258755b29f9e2d
I20260808 18:41:15.985087 25160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:15.990499 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.61.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.252@KRBTEST.COM" created.
I20260808 18:41:15.998208 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } attempt: 3
Aug 08 18:41:15 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:41:16.007540 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.992988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40716 (local address 127.4.61.254:40639)
0808 18:41:15.993185 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:15.993191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:15.994027 (+ 836us) server_negotiation.cc:407] Connection header received
0808 18:41:15.994987 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:15.994991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:15.995043 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:15.995116 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:15.996415 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.997156 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.998295 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.998669 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.998768 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.002987 (+ 4219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.002991 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.002994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.003021 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.005200 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.005751 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.005754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.005756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.005846 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.006226 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.006228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.006229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.006474 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.006601 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.007210 (+ 609us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.007356 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 18:41:16.007668 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.998694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34814)
0808 18:41:15.998888 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.998904 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:15.998972 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:15.999554 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:15.999557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:15.999745 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:15.999848 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:15.999854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.000805 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.000809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.001592 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.001604 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.002165 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.002169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.002271 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.002729 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.002744 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.004294 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.006117 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.006120 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.006122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.006386 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.006678 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.006681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.006683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.006789 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.007262 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.007266 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.007356 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.007434 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.007549 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 18:41:16.008419 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.998824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.4.61.253:40681)
0808 18:41:15.999171 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:15.999180 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:15.999201 (+ 21us) server_negotiation.cc:407] Connection header received
0808 18:41:15.999235 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:15.999239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:15.999399 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:15.999546 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:15.999959 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.000696 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.001713 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.002057 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.002149 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.004428 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.004436 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.004450 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.004477 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.006026 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.006503 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.006509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.006511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.006601 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.006874 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.006877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.006879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.007142 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.007941 (+ 799us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.008032 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.008150 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":156,"threads_started":1}
I20260808 18:41:16.008426 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:15.993360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40639 (local address 127.0.0.1:40716)
0808 18:41:15.993885 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:15.993930 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:15.994783 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:15.995268 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:15.995274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:15.995707 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:15.996255 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:15.996271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.997272 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.997274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:15.998159 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:15.998169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:15.998948 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:15.998953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:15.999144 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.000914 (+ 1770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.000935 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.002838 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.005329 (+ 2491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.005338 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.005349 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.005648 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.005943 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.005945 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.005947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.006126 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.006603 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.006609 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.006908 (+ 299us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.007076 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.007398 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":133,"threads_started":1}
I20260808 18:41:16.009848 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.011361 25031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.012106 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.011831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41156)
0808 18:41:16.011955 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.012018 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 18:41:16.012920 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.012662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41158)
0808 18:41:16.012809 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.012863 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 18:41:16.013051 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
I20260808 18:41:16.014263 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:46341
--webserver_interface=127.4.61.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:41:16.018867 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.010471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34822)
0808 18:41:16.010655 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.010671 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.010760 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.011057 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.011061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.011344 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.011458 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.011465 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.012401 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.012405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.012965 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.012975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.013484 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.013487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.013597 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.014046 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.014062 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.015557 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.017100 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.017104 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.017106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.017382 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.017719 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.017722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.017724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.017817 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.018293 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.018297 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.018502 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.018607 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.018733 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":3}
I20260808 18:41:16.018991 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.010694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.4.61.253:40681)
0808 18:41:16.010817 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.010821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.010836 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:41:16.010870 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.010872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.010913 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.010998 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.011580 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.012304 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.013084 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.013387 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.013473 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.015690 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.015694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.015696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.015721 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.016988 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.017492 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.017495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.017498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.017601 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.017905 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.017908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.017909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.018143 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.018239 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.018696 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.018819 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":46}
I20260808 18:41:16.019874 25160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.020594 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.020327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41166)
0808 18:41:16.020443 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.020533 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 18:41:16.021401 25065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
I20260808 18:41:16.022432 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.022156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41174)
0808 18:41:16.022292 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.022369 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 18:41:16.022569 25160 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
I20260808 18:41:16.044235 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 1
I20260808 18:41:16.045078 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.044781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41188)
0808 18:41:16.044933 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.044996 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 18:41:16.045827 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.045642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41192)
0808 18:41:16.045729 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.045771 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 18:41:16.045949 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
I20260808 18:41:16.071884 25160 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 1
I20260808 18:41:16.072897 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.072524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41196)
0808 18:41:16.072729 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.072802 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 18:41:16.073738 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.073486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41212)
0808 18:41:16.073609 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.073660 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 18:41:16.073870 25160 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
I20260808 18:41:16.121110 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 2
I20260808 18:41:16.122044 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.121720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41224)
0808 18:41:16.121887 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.121959 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 18:41:16.122828 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.122601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41226)
0808 18:41:16.122710 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.122764 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 18:41:16.122995 25031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
W20260808 18:41:16.130153 25167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:16.130429 25167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:16.130501 25167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:16.134502 25167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:16.134552 25167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:16.134578 25167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:16.134608 25167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:16.134639 25167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:16.139792 25167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40639,127.4.61.253:40681,127.4.61.252:46341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:46341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.61.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:16.140789 25167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:16.141790 25167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:41:16.142048 25160 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 2
I20260808 18:41:16.142865 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.142559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41236)
0808 18:41:16.142706 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.142782 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 18:41:16.143615 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.143387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41242)
0808 18:41:16.143502 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.143551 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 18:41:16.143748 25160 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:46341: Network error: Client connection negotiation failed: client connection to 127.4.61.252:46341: connect: Connection refused (error 111)
W20260808 18:41:16.150121 25179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:16.150125 25184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:16.150121 25182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:16.150568 25167 server_base.cc:1034] running on GCE node
I20260808 18:41:16.151219 25167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:16.152366 25167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:16.153537 25167 hybrid_clock.cc:648] HybridClock initialized: now 1786214476153517 us; error 31 us; skew 500 ppm
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214476, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:16.156502 25167 init.cc:377] Logged in from keytab as kudu/127.4.61.252@KRBTEST.COM (short username kudu)
I20260808 18:41:16.157547 25167 webserver.cc:460] Webserver started at http://127.4.61.252:33991/ using document root <none> and password file <none>
I20260808 18:41:16.158149 25167 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:16.158221 25167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:16.158483 25167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:16.160641 25167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data/instance:
uuid: "7323d418c89c45c2ac7dbef00b9258cf"
format_stamp: "Formatted at 2026-08-08 18:41:16 on dist-test-slave-fgb3"
server_key: "ff50fc106beb5cc822a454a5a7faebc9"
server_key_iv: "8b3391b1c33b58ab0ebb3ed52853465f"
server_key_version: "encryptionkey@0"
I20260808 18:41:16.161207 25167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal/instance:
uuid: "7323d418c89c45c2ac7dbef00b9258cf"
format_stamp: "Formatted at 2026-08-08 18:41:16 on dist-test-slave-fgb3"
server_key: "ff50fc106beb5cc822a454a5a7faebc9"
server_key_iv: "8b3391b1c33b58ab0ebb3ed52853465f"
server_key_version: "encryptionkey@0"
I20260808 18:41:16.164968 25167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:41:16.167443 25197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:16.168589 25167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:16.168704 25167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "7323d418c89c45c2ac7dbef00b9258cf"
format_stamp: "Formatted at 2026-08-08 18:41:16 on dist-test-slave-fgb3"
server_key: "ff50fc106beb5cc822a454a5a7faebc9"
server_key_iv: "8b3391b1c33b58ab0ebb3ed52853465f"
server_key_version: "encryptionkey@0"
I20260808 18:41:16.168798 25167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:16.184725 25167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:16.187634 25167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:16.187813 25167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:16.194607 25167 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.252:46341
I20260808 18:41:16.194677 25280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.252:46341 every 8 connection(s)
I20260808 18:41:16.195550 25167 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
I20260808 18:41:16.198287 25281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:16.201999 25281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.202560 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25167
I20260808 18:41:16.202683 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786214311986709-4343-0/minicluster-data/master-2/wal/instance
I20260808 18:41:16.202979 4343 external_mini_cluster.cc:1428] Setting key d57ad63a41c176e2088e7e8f8dd0c1e3
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214476, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:41:16.215415 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.204116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.4.61.254:40639)
0808 18:41:16.204255 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.204259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.204955 (+ 696us) server_negotiation.cc:407] Connection header received
0808 18:41:16.205842 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.205845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.205895 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.205968 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.207252 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.207749 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.208777 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.208996 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.209073 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.211677 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.211680 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.211682 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.211708 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.213196 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.213803 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.213807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.213809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.213897 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.214244 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.214246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.214248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.214487 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.214572 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.215108 (+ 536us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.215238 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:41:16.216248 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.204417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40639 (local address 127.0.0.1:40726)
0808 18:41:16.204823 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.204862 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.205643 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.206461 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.206467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.206813 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.207093 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.207106 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.207854 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.207857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.208651 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.208660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.209126 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.209131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.209280 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.209942 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.209960 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.211529 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.213325 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.213334 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.213343 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.213703 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.213979 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.213982 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.213984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.214161 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.214586 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.214592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.214863 (+ 271us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.215041 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.215384 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":3,"spinlock_wait_cycles":1792,"thread_start_us":95,"threads_started":1}
I20260808 18:41:16.216259 25289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.205086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41250 (local address 127.4.61.252:46341)
0808 18:41:16.205343 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.205351 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.205385 (+ 34us) server_negotiation.cc:407] Connection header received
0808 18:41:16.205649 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.205671 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.205851 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.205995 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.206843 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.207939 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.208769 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.209176 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.209286 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.212033 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.212038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.212049 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.212072 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.213745 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.214182 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.214187 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.214188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.214277 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.214566 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.214569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.214570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.214841 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.214983 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.215226 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.215594 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":210,"server-negotiator.queue_time_us":176,"thread_start_us":64,"threads_started":1}
I20260808 18:41:16.217908 25281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.222159 25031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 3
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214476, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:16.226646 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.218650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.4.61.253:40681)
0808 18:41:16.218766 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.218771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.219028 (+ 257us) server_negotiation.cc:407] Connection header received
0808 18:41:16.219193 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.219196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.219252 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.219360 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.219721 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.220227 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.220944 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.221229 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.221312 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.223365 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.223369 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.223372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.223398 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.224928 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.225325 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.225329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.225331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.225425 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.225734 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.225738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.225739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.225977 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.226079 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.226367 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.226483 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:41:16.226917 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.218544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40681 (local address 127.0.0.1:34830)
0808 18:41:16.218958 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.218971 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.219088 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.219396 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.219399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.219525 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.219615 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.219620 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.220346 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.220350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.220841 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.220848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.221359 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.221363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.221460 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.221915 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.221925 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.223237 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.225039 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.225042 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.225044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.225235 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.225531 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.225535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.225537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.225634 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.226071 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.226073 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.226169 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.226279 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.226668 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"spinlock_wait_cycles":1792}
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:41:16.228170 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.218853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40730 (local address 127.4.61.254:40639)
0808 18:41:16.218956 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.218960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.218973 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:41:16.219007 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.219011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.219054 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.219121 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.219777 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.220240 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.221079 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.221277 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.221371 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.224194 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.224197 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.224200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.224226 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.226013 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.226505 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.226509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.226510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.226594 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.227002 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.227006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.227007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.227210 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.227377 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.227900 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.228012 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 18:41:16.228188 25281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:41:16.232184 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.222553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41266)
0808 18:41:16.222719 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.222731 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.222797 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.223712 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.223716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.223885 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.223979 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.223986 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.225075 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.225078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.225642 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.225651 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.226185 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.226188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.226277 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.226969 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.226984 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.228234 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.230720 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.230723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.230725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.230975 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.231244 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.231247 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.231249 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.231342 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.231719 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.231722 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.231821 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.231904 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.232026 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260808 18:41:16.232198 25289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.222618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41266 (local address 127.4.61.252:46341)
0808 18:41:16.223519 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.223522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.223532 (+ 10us) server_negotiation.cc:407] Connection header received
0808 18:41:16.223559 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.223561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.223593 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.223671 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.224092 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.224982 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.225787 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.226053 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.226176 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.228374 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.228377 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.228379 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.228402 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.230618 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.231071 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.231074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.231076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.231160 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.231418 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.231421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.231423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.231603 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.231719 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.231970 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.232066 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"spinlock_wait_cycles":768}
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:41:16.234903 25160 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } attempt: 3
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214476, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:41:16.235453 25031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: Bootstrap starting.
I20260808 18:41:16.238605 25031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:16.238938 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.229759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34846 (local address 127.4.61.253:40681)
0808 18:41:16.230105 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.230109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.230123 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:41:16.230156 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.230159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.230195 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.230267 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.230941 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.231552 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.232358 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.232685 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.232760 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.235212 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.235216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.235219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.235242 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.237068 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.237515 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.237518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.237520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.237602 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.237900 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.237903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.237905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.238112 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.238339 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.238682 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.238792 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260808 18:41:16.239194 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.228647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41270)
0808 18:41:16.228749 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.228762 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.228833 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.229390 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.229393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.229555 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.229618 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.229623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.230577 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.230580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.231247 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.231257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.232436 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.232439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.232519 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.232924 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.232938 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.235519 (+ 2581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.237705 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.237708 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.237709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.237918 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.238179 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.238181 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.238183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.238253 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.238762 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.238764 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.238848 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.238943 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.239054 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 18:41:16.239589 25031 log.cc:824] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:16.239737 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.228921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41270 (local address 127.4.61.252:46341)
0808 18:41:16.229208 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.229214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.229224 (+ 10us) server_negotiation.cc:407] Connection header received
0808 18:41:16.229250 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.229252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.229283 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.229365 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.229712 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.230490 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.231369 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.231650 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.231740 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.235645 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.235649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.235651 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.235672 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.237590 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.238024 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.238027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.238029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.238100 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.238400 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.238403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.238404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.238640 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.238727 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.239474 (+ 747us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.239570 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":124,"threads_started":1}
Aug 08 18:41:16 dist-test-slave-fgb3 krb5kdc[24902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214475, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:41:16.241605 25031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: No bootstrap required, opened a new log
I20260808 18:41:16.242556 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: Bootstrap starting.
I20260808 18:41:16.245273 25281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:16.245361 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:41:16.245402 25031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.245651 25031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:16.245715 25031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729dcf47a75d4f8d9fdb0f86d8c85d07, State: Initialized, Role: FOLLOWER
I20260808 18:41:16.246119 25281 log.cc:824] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:16.246153 25031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.246623 25292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.246762 25292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:41:16.247402 25031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:16.248667 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.235244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:46341 (local address 127.0.0.1:41286)
0808 18:41:16.235478 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:16.235491 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:16.235559 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:16.236121 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:16.236124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:16.236280 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:16.236377 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.236384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.237515 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.237518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.238263 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:16.238274 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.238931 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.238935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:16.239012 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.240563 (+ 1551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:16.240577 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:16.241928 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:16.245008 (+ 3080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.245011 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.245013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.245249 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.247581 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:16.247584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:16.247586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:16.247695 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:16.248105 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:16.248109 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:16.248222 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 18:41:16.248349 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 18:41:16.248506 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260808 18:41:16.249193 25289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.235708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41286 (local address 127.4.61.252:46341)
0808 18:41:16.235898 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.235902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.235915 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:41:16.235946 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.235949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.235986 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.236096 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.236485 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.237396 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.238435 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.238812 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.241093 (+ 2281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.242061 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.242064 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.242067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.242091 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.244569 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.247375 (+ 2806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.247378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.247380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.247469 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.247826 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.247829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.247831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.248006 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.248086 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.248867 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.248996 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 18:41:16.252061 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: Bootstrap starting.
W20260808 18:41:16.252619 25317 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:41:16.252703 25317 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:41:16.254226 25160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: Neither blocks nor log segments found. Creating new log.
W20260808 18:41:16.254272 24954 tablet.cc:2369] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:16.255621 25160 log.cc:824] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:16.257427 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: No bootstrap required, opened a new log
I20260808 18:41:16.256387 24919 master_runner.cc:186] Error getting master registration for 127.4.61.253:40681: OK, instance_id { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" instance_seqno: 1786214475978578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 18:41:16.259723 24919 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 18:41:16.262193 25160 raft_consensus.cc:348] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.262442 25160 raft_consensus.cc:374] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:16.262496 25160 raft_consensus.cc:729] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f185f0a213f74e36847c70fe482113b6, State: Initialized, Role: FOLLOWER
I20260808 18:41:16.262831 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: No bootstrap required, opened a new log
I20260808 18:41:16.264880 25160 consensus_queue.cc:260] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.266290 25160 sys_catalog.cc:564] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:16.266939 25281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.267266 25281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:16.267397 25281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7323d418c89c45c2ac7dbef00b9258cf, State: Initialized, Role: FOLLOWER
I20260808 18:41:16.267927 25281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.268502 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.248404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40738 (local address 127.4.61.254:40639)
0808 18:41:16.248512 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.248517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.259252 (+ 10735us) server_negotiation.cc:407] Connection header received
0808 18:41:16.259428 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.259432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.259479 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.259525 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.260543 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.261305 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.262520 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.262853 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.262927 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.264996 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.265000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.265003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.265032 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.266678 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.267144 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.267148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.267150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.267234 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.267535 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.267539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.267541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.267752 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.267865 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.268206 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.268342 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:41:16.269769 25281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:16.273519 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.247559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.4.61.253:40681)
0808 18:41:16.247670 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.247674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.249271 (+ 1597us) server_negotiation.cc:407] Connection header received
0808 18:41:16.249794 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.249797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.249844 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.249888 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.259029 (+ 9141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.259727 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.263676 (+ 3949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.264028 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.264103 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.270038 (+ 5935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.270042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.270045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.270073 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.271684 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.272156 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.272160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.272162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.272252 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.272570 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.272573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.272575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.272789 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.272915 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.273241 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.273368 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:41:16.274502 25341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.274636 25341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:41:16.274864 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.274998 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 18:41:16.279336 25360 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:41:16.279415 25360 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:41:16.280555 25041 master_runner.cc:263] No leader master found from master f185f0a213f74e36847c70fe482113b6
I20260808 18:41:16.280624 25041 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 18:41:16.280704 25167 master_runner.cc:263] No leader master found from master 7323d418c89c45c2ac7dbef00b9258cf
I20260808 18:41:16.280757 25167 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 18:41:16.281402 25344 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:41:16.281481 25344 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:41:16.281599 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:16.248930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41288 (local address 127.4.61.252:46341)
0808 18:41:16.249151 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:16.249155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:16.261239 (+ 12084us) server_negotiation.cc:407] Connection header received
0808 18:41:16.272223 (+ 10984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:16.272227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:16.272278 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:16.272340 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:16.273138 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.273881 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.275392 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:16.275742 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:16.275838 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:16.277481 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:16.277486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:16.277488 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:16.277514 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:16.279160 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.279730 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.279734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.279735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.279823 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:16.280114 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:16.280118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:16.280119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:16.280426 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:16.280568 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:16.281341 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 18:41:16.281457 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 18:41:16.404438 25321 raft_consensus.cc:482] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:16.404624 25321 raft_consensus.cc:504] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.405577 25321 leader_election.cc:288] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729dcf47a75d4f8d9fdb0f86d8c85d07 (127.4.61.254:40639), 7323d418c89c45c2ac7dbef00b9258cf (127.4.61.252:46341)
I20260808 18:41:16.406453 25238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f185f0a213f74e36847c70fe482113b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7323d418c89c45c2ac7dbef00b9258cf" is_pre_election: true
I20260808 18:41:16.407110 25238 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f185f0a213f74e36847c70fe482113b6 in term 0.
I20260808 18:41:16.407653 25065 leader_election.cc:302] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7323d418c89c45c2ac7dbef00b9258cf, f185f0a213f74e36847c70fe482113b6; no voters:
I20260808 18:41:16.408790 24989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f185f0a213f74e36847c70fe482113b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" is_pre_election: true
I20260808 18:41:16.409094 24989 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f185f0a213f74e36847c70fe482113b6 in term 0.
I20260808 18:41:16.409791 25321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:16.409888 25321 raft_consensus.cc:482] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:16.409926 25321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:16.411412 25321 raft_consensus.cc:504] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.411867 25321 leader_election.cc:288] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [CANDIDATE]: Term 1 election: Requested vote from peers 729dcf47a75d4f8d9fdb0f86d8c85d07 (127.4.61.254:40639), 7323d418c89c45c2ac7dbef00b9258cf (127.4.61.252:46341)
I20260808 18:41:16.412458 25238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f185f0a213f74e36847c70fe482113b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7323d418c89c45c2ac7dbef00b9258cf"
I20260808 18:41:16.412593 25238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:16.413944 25238 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f185f0a213f74e36847c70fe482113b6 in term 1.
I20260808 18:41:16.414707 24989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f185f0a213f74e36847c70fe482113b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07"
I20260808 18:41:16.414858 24989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:16.416164 24989 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f185f0a213f74e36847c70fe482113b6 in term 1.
I20260808 18:41:16.416500 25065 leader_election.cc:302] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7323d418c89c45c2ac7dbef00b9258cf, f185f0a213f74e36847c70fe482113b6; no voters:
I20260808 18:41:16.417052 25321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:16.417349 25321 raft_consensus.cc:686] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [term 1 LEADER]: Becoming Leader. State: Replica: f185f0a213f74e36847c70fe482113b6, State: Running, Role: LEADER
I20260808 18:41:16.417785 25321 consensus_queue.cc:237] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } }
I20260808 18:41:16.420042 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f185f0a213f74e36847c70fe482113b6. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.420225 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:16.421757 25366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:16.424038 25366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:16.431111 25238 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [term 1 FOLLOWER]: Refusing update from remote peer f185f0a213f74e36847c70fe482113b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:16.432024 25363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:16.433517 24989 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [term 1 FOLLOWER]: Refusing update from remote peer f185f0a213f74e36847c70fe482113b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:16.434180 25363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:16.436736 25341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f185f0a213f74e36847c70fe482113b6. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.436890 25341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: This master's current role is: FOLLOWER
W20260808 18:41:16.439158 25210 tablet.cc:2369] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:16.439810 25292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f185f0a213f74e36847c70fe482113b6. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.439939 25292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:41:16.441504 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.441636 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:16.442873 25368 mvcc.cc:205] Tried to move back new op lower bound from 7316334495453044736 to 7316334495411703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316334495453044736}]
I20260808 18:41:16.442931 25341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.443063 25341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:41:16.443270 25363 sys_catalog.cc:455] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.443389 25363 sys_catalog.cc:458] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:16.443351 25369 mvcc.cc:205] Tried to move back new op lower bound from 7316334495453044736 to 7316334495411703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316334495453044736}]
I20260808 18:41:16.444607 25292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f185f0a213f74e36847c70fe482113b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729dcf47a75d4f8d9fdb0f86d8c85d07" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40639 } } peers { permanent_uuid: "f185f0a213f74e36847c70fe482113b6" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40681 } } peers { permanent_uuid: "7323d418c89c45c2ac7dbef00b9258cf" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 46341 } } }
I20260808 18:41:16.444728 25292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:41:16.445281 25378 mvcc.cc:205] Tried to move back new op lower bound from 7316334495453044736 to 7316334495411703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316334495453044736}]
I20260808 18:41:16.447052 25366 catalog_manager.cc:1347] Generated new cluster ID: 959fa612c33247f088d057e050416613
I20260808 18:41:16.447121 25366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:16.476883 25366 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:41:16.477862 25366 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:16.490037 25366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f185f0a213f74e36847c70fe482113b6: Generated new TSK 0
I20260808 18:41:16.491039 25366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:41:17.254004 25317 catalog_manager.cc:1259] Loaded cluster ID: 959fa612c33247f088d057e050416613
I20260808 18:41:17.254088 25317 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: loading cluster ID for follower catalog manager: success
I20260808 18:41:17.255764 25317 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: acquiring CA information for follower catalog manager: success
I20260808 18:41:17.256942 25317 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 729dcf47a75d4f8d9fdb0f86d8c85d07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:41:17.280831 25360 catalog_manager.cc:1259] Loaded cluster ID: 959fa612c33247f088d057e050416613
I20260808 18:41:17.280925 25360 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: loading cluster ID for follower catalog manager: success
I20260808 18:41:17.282729 25360 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: acquiring CA information for follower catalog manager: success
I20260808 18:41:17.283932 25360 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7323d418c89c45c2ac7dbef00b9258cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:41:17.566222 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 24919
I20260808 18:41:17.580291 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25041
I20260808 18:41:17.588757 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25167
2026-08-08T18:41:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3294 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:41:17 dist-test-slave-fgb3 krb5kdc[25394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:41:17 dist-test-slave-fgb3 krb5kdc[25394](info): set up 2 sockets
Aug 08 18:41:17 dist-test-slave-fgb3 krb5kdc[25394](info): commencing operation
krb5kdc: starting...
W20260808 18:41:18.738888 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:41:18 dist-test-slave-fgb3 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:41:18.861303 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36923
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:18.971942 25415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:18.972198 25415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:18.972249 25415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:18.976151 25415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:18.976210 25415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:18.976234 25415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:18.976250 25415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:18.976276 25415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:18.981498 25415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:36923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:18.982568 25415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:18.983603 25415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:41:18.992105 25415 server_base.cc:1034] running on GCE node
W20260808 18:41:18.992057 25425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:18.992049 25426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:18.992057 25428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:18.992939 25415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:18.994077 25415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:18.995275 25415 hybrid_clock.cc:648] HybridClock initialized: now 1786214478995240 us; error 48 us; skew 500 ppm
Aug 08 18:41:18 dist-test-slave-fgb3 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214478, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:18.998545 25415 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:18.999429 25415 webserver.cc:460] Webserver started at http://127.4.61.254:43619/ using document root <none> and password file <none>
I20260808 18:41:18.999965 25415 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:19.000025 25415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:19.000198 25415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:19.002249 25415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "bfafc5d786804a91aed0c33ea82ea391"
format_stamp: "Formatted at 2026-08-08 18:41:18 on dist-test-slave-fgb3"
server_key: "3a8733a09305221d138c80e782127fae"
server_key_iv: "bbc1cdd6475694a6bf8aacc90a92807c"
server_key_version: "encryptionkey@0"
I20260808 18:41:19.002839 25415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "bfafc5d786804a91aed0c33ea82ea391"
format_stamp: "Formatted at 2026-08-08 18:41:18 on dist-test-slave-fgb3"
server_key: "3a8733a09305221d138c80e782127fae"
server_key_iv: "bbc1cdd6475694a6bf8aacc90a92807c"
server_key_version: "encryptionkey@0"
I20260808 18:41:19.006486 25415 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:41:19.008967 25438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:19.010177 25415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:19.010293 25415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "bfafc5d786804a91aed0c33ea82ea391"
format_stamp: "Formatted at 2026-08-08 18:41:18 on dist-test-slave-fgb3"
server_key: "3a8733a09305221d138c80e782127fae"
server_key_iv: "bbc1cdd6475694a6bf8aacc90a92807c"
server_key_version: "encryptionkey@0"
I20260808 18:41:19.010428 25415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:19.056932 25415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:19.060127 25415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:19.060324 25415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:19.067167 25415 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:36923
I20260808 18:41:19.067198 25520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:36923 every 8 connection(s)
I20260808 18:41:19.068149 25415 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:19.071070 25521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:19.076731 25521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391: Bootstrap starting.
I20260808 18:41:19.077952 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25415
I20260808 18:41:19.078083 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:41:19.078413 4343 external_mini_cluster.cc:1428] Setting key 10ad198ab92f083739a6aacda8385584
I20260808 18:41:19.079509 25521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:19.080283 25521 log.cc:824] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:19.082571 25521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391: No bootstrap required, opened a new log
I20260808 18:41:19.086890 25521 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } }
I20260808 18:41:19.087129 25521 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:19.087198 25521 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfafc5d786804a91aed0c33ea82ea391, State: Initialized, Role: FOLLOWER
Aug 08 18:41:19 dist-test-slave-fgb3 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:19.087720 25521 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } }
I20260808 18:41:19.087913 25521 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:19.087991 25521 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:19.088092 25521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:19.089159 25521 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } }
I20260808 18:41:19.089502 25521 leader_election.cc:302] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfafc5d786804a91aed0c33ea82ea391; no voters:
I20260808 18:41:19.089855 25521 leader_election.cc:288] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:41:19.089947 25528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:19.090166 25528 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [term 1 LEADER]: Becoming Leader. State: Replica: bfafc5d786804a91aed0c33ea82ea391, State: Running, Role: LEADER
I20260808 18:41:19.090582 25528 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } }
I20260808 18:41:19.091218 25521 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:19.091866 25528 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfafc5d786804a91aed0c33ea82ea391. Latest consensus state: current_term: 1 leader_uuid: "bfafc5d786804a91aed0c33ea82ea391" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } } }
I20260808 18:41:19.092478 25532 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfafc5d786804a91aed0c33ea82ea391" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfafc5d786804a91aed0c33ea82ea391" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36923 } } }
I20260808 18:41:19.092597 25528 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:19.092702 25532 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:19.093122 25542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:19.093164 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:19.079499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.4.61.254:36923)
0808 18:41:19.079916 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:19.079932 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:19.079970 (+ 38us) server_negotiation.cc:407] Connection header received
0808 18:41:19.080643 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:19.080668 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:19.081108 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:19.081404 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:19.082288 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:19.083336 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:19.084512 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:19.084984 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:19.085101 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:19.088002 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:19.088009 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:19.088026 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:19.088060 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:19.089749 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:19.090243 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:19.090249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:19.090256 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:19.090436 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:19.090777 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:19.090780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:19.090782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:19.091326 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:19.091517 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:19.091821 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 18:41:19.092131 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":120,"threads_started":1}
I20260808 18:41:19.096395 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:41:19.096598 25542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:19.101824 25542 catalog_manager.cc:1347] Generated new cluster ID: 66c90cfc8f8342b68da08464d77b41a1
I20260808 18:41:19.101891 25542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:19.112046 25542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:41:19.113047 25542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:19.121812 25542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfafc5d786804a91aed0c33ea82ea391: Generated new TSK 0
I20260808 18:41:19.122591 25542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:41:19.152338 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25415
2026-08-08T18:41:19Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1560 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:41:19 dist-test-slave-fgb3 krb5kdc[25559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:41:19 dist-test-slave-fgb3 krb5kdc[25559](info): set up 2 sockets
Aug 08 18:41:19 dist-test-slave-fgb3 krb5kdc[25559](info): commencing operation
krb5kdc: starting...
W20260808 18:41:20.281864 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:41:20 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:41:20.402834 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:20.514748 25583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:20.515028 25583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:20.515069 25583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:20.519063 25583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:20.519124 25583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:20.519143 25583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:20.519158 25583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:20.519172 25583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:20.524354 25583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:20.525369 25583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:20.526363 25583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:20.534626 25591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:20.534814 25583 server_base.cc:1034] running on GCE node
W20260808 18:41:20.534643 25594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:20.534638 25596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:20.535493 25583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:20.536542 25583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:20.537727 25583 hybrid_clock.cc:648] HybridClock initialized: now 1786214480537700 us; error 38 us; skew 500 ppm
Aug 08 18:41:20 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214480, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:20.552913 25583 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:20.553887 25583 webserver.cc:460] Webserver started at http://127.4.61.254:44585/ using document root <none> and password file <none>
I20260808 18:41:20.554491 25583 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:20.554564 25583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:20.554766 25583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:20.556816 25583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "89f2e6b87bbd44069d6012cb2269c066"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "6a72fe0697d28ebee9bcdcbc7fccfeb8"
server_key_iv: "aca499f8fe77be5cfcf4d52a7cf7246d"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.557350 25583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "89f2e6b87bbd44069d6012cb2269c066"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "6a72fe0697d28ebee9bcdcbc7fccfeb8"
server_key_iv: "aca499f8fe77be5cfcf4d52a7cf7246d"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.561004 25583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260808 18:41:20.563475 25607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:20.564766 25583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:20.564920 25583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "89f2e6b87bbd44069d6012cb2269c066"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "6a72fe0697d28ebee9bcdcbc7fccfeb8"
server_key_iv: "aca499f8fe77be5cfcf4d52a7cf7246d"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.565025 25583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:20.582280 25583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:20.585810 25583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:20.586018 25583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:20.593088 25583 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:36383
I20260808 18:41:20.593336 25683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:36383 every 8 connection(s)
I20260808 18:41:20.594074 25583 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:20.596868 25684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:20.599212 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25583
I20260808 18:41:20.599321 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:41:20.599584 4343 external_mini_cluster.cc:1428] Setting key 4058d42cbdf8a494c396f69655e6d492
I20260808 18:41:20.603235 25684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap starting.
I20260808 18:41:20.605820 25684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:20.606668 25684 log.cc:824] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:41:20 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:20.608898 25684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: No bootstrap required, opened a new log
I20260808 18:41:20.613466 25684 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:20.613790 25684 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:20.613848 25684 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Initialized, Role: FOLLOWER
I20260808 18:41:20.614423 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:20.600900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.4.61.254:36383)
0808 18:41:20.601310 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:20.601326 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:20.601361 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:41:20.602059 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:20.602079 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:20.602470 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:20.602763 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:20.603678 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.604670 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.605871 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.606437 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.606567 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:20.609202 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:20.609209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:20.609227 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:20.609262 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:20.611178 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:20.611580 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:20.611586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:20.611592 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:20.611743 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:20.611969 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:20.611972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:20.611974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:20.612497 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:20.612706 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:20.612921 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 18:41:20.613235 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":115,"threads_started":1}
I20260808 18:41:20.614513 25684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:20.614681 25684 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:20.614753 25684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:20.614861 25684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:20.616066 25684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:20.616444 25684 leader_election.cc:302] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89f2e6b87bbd44069d6012cb2269c066; no voters:
I20260808 18:41:20.616792 25684 leader_election.cc:288] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:41:20.616894 25691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:20.617190 25691 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 LEADER]: Becoming Leader. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Running, Role: LEADER
I20260808 18:41:20.617501 25691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:20.618093 25684 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:20.619199 25692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:20.619318 25692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:20.619709 25705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:20.620386 25693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89f2e6b87bbd44069d6012cb2269c066. Latest consensus state: current_term: 1 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:20.620484 25693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:20.622545 25705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:20.628123 25705 catalog_manager.cc:1347] Generated new cluster ID: ea30c33e33384a41ae63769a87bdb4ee
I20260808 18:41:20.628194 25705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:20.646538 25705 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:41:20.647512 25705 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:20.655534 25705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Generated new TSK 0
I20260808 18:41:20.656252 25705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:41:20.687059 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:20.801205 25724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:20.801496 25724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:20.801540 25724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:20.805610 25724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:20.805670 25724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:20.805732 25724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:20.811003 25724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:20.812071 25724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:20.813102 25724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:20.822926 25739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:20.822937 25735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:20.822938 25742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:20.823027 25724 server_base.cc:1034] running on GCE node
I20260808 18:41:20.823464 25724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:20.824105 25724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:20.825315 25724 hybrid_clock.cc:648] HybridClock initialized: now 1786214480825290 us; error 35 us; skew 500 ppm
Aug 08 18:41:20 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214480, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:20.828105 25724 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:20.828929 25724 webserver.cc:460] Webserver started at http://127.4.61.193:41979/ using document root <none> and password file <none>
I20260808 18:41:20.829445 25724 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:20.829502 25724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:20.829669 25724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:20.831653 25724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "d9f68471179e441a9d1b836e0e65a6c3"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "67edbb20608e56726015584c43cc6059"
server_key_iv: "386be84c822ea8114c6883d50290af3e"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.832165 25724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "d9f68471179e441a9d1b836e0e65a6c3"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "67edbb20608e56726015584c43cc6059"
server_key_iv: "386be84c822ea8114c6883d50290af3e"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.835661 25724 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:41:20.838104 25755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:20.839344 25724 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:20.839444 25724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "d9f68471179e441a9d1b836e0e65a6c3"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "67edbb20608e56726015584c43cc6059"
server_key_iv: "386be84c822ea8114c6883d50290af3e"
server_key_version: "encryptionkey@0"
I20260808 18:41:20.839526 25724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:20.855104 25724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:20.858114 25724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:20.858299 25724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:20.858891 25724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:20.859674 25724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:20.859721 25724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:20.859759 25724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:20.859787 25724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:20.869433 25724 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:35247
I20260808 18:41:20.869483 25916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:35247 every 8 connection(s)
I20260808 18:41:20.870517 25724 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:20.874447 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25724
I20260808 18:41:20.874585 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:41:20.874850 4343 external_mini_cluster.cc:1428] Setting key 4dc7910a4aa47c584a3f726669e64a73
Aug 08 18:41:20 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214480, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:20.884989 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:20.872448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:55085 (local address 127.4.61.254:36383)
0808 18:41:20.872586 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:20.872590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:20.873695 (+ 1105us) server_negotiation.cc:407] Connection header received
0808 18:41:20.874749 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:20.874753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:20.874821 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:20.874903 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:20.876249 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.876991 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.878444 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.878677 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.878769 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:20.881310 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:20.881314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:20.881317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:20.881348 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:20.882891 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:20.883434 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:20.883438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:20.883440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:20.883540 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:20.883844 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:20.883848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:20.883850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:20.884083 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:20.884192 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:20.884667 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 18:41:20.884813 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:41:20.885732 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:20.872815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:55085)
0808 18:41:20.873532 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:20.873576 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:20.874496 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:20.875098 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:20.875106 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:20.875579 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:20.876094 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:20.876113 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.877127 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.877130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:20.878334 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:20.878348 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:20.878826 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:20.878831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:20.879014 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:20.879572 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:20.879589 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:20.881133 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:20.883011 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:20.883016 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:20.883028 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:20.883282 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:20.883626 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:20.883629 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:20.883630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:20.883758 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:20.884175 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:20.884180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:20.884421 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 18:41:20.884590 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 18:41:20.884844 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:41:20.886981 25918 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:20.887226 25918 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:20.887728 25918 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:41:20.889467 25634 ts_manager.cc:194] Registered new tserver with Master: d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247)
I20260808 18:41:20.890645 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:55085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:41:20.903476 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:21.014895 25924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:21.015218 25924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:21.015283 25924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:21.019541 25924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:21.019608 25924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:21.019687 25924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:21.025086 25924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:21.026216 25924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:21.027298 25924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:21.037043 25939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:21.037030 25931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:21.037256 25924 server_base.cc:1034] running on GCE node
W20260808 18:41:21.037030 25933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:21.037851 25924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:21.038584 25924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:21.039758 25924 hybrid_clock.cc:648] HybridClock initialized: now 1786214481039737 us; error 35 us; skew 500 ppm
Aug 08 18:41:21 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:21.042589 25924 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:21.043535 25924 webserver.cc:460] Webserver started at http://127.4.61.194:43957/ using document root <none> and password file <none>
I20260808 18:41:21.044106 25924 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:21.044174 25924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:21.044392 25924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:21.046463 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "29706d568f374e5b943ff589be818c96"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "cae2195a1d1a33ccfd6121dedcc0ea18"
server_key_iv: "04ce0b378c3f9e68e18e89f2a17328b4"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.047027 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "29706d568f374e5b943ff589be818c96"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "cae2195a1d1a33ccfd6121dedcc0ea18"
server_key_iv: "04ce0b378c3f9e68e18e89f2a17328b4"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.050839 25924 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:41:21.053361 25954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.054601 25924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:21.054723 25924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "29706d568f374e5b943ff589be818c96"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "cae2195a1d1a33ccfd6121dedcc0ea18"
server_key_iv: "04ce0b378c3f9e68e18e89f2a17328b4"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.054826 25924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:21.086987 25924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:21.090250 25924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:21.090451 25924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:21.091070 25924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:21.091898 25924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:21.091955 25924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.092011 25924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:21.092039 25924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.100462 25924 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:40495
I20260808 18:41:21.100531 26130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:40495 every 8 connection(s)
I20260808 18:41:21.101354 25924 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
Aug 08 18:41:21 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:21.110608 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 25924
I20260808 18:41:21.110713 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:41:21.111006 4343 external_mini_cluster.cc:1428] Setting key e0c83370373019e6d74b0bf4f6eac032
I20260808 18:41:21.115808 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.103163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:59083 (local address 127.4.61.254:36383)
0808 18:41:21.103309 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.103314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.104352 (+ 1038us) server_negotiation.cc:407] Connection header received
0808 18:41:21.105182 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.105185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.105233 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.105309 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:21.106449 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.106986 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.108198 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.108431 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.108520 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.110834 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:21.110837 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:21.110839 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:21.110864 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:21.112204 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.112741 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.112745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.112747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.112838 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.114440 (+ 1602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.114444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.114450 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.114712 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:21.114818 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.115503 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.115641 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:41:21.116721 26135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.103571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:59083)
0808 18:41:21.104210 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.104253 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.105006 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.105467 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.105473 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.105816 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:21.106284 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.106298 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.107082 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.107085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.108049 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.108059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.108561 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.108563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.108706 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.109210 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:21.109226 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:21.110633 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:21.112322 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:21.112328 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:21.112342 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:21.112642 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:21.112920 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:21.112922 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:21.112923 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:21.113059 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:21.114840 (+ 1781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:21.114848 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:21.115215 (+ 367us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.115442 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.115727 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":116,"threads_started":1}
I20260808 18:41:21.117882 26131 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:21.118162 26131 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:21.118697 26131 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
I20260808 18:41:21.119745 25634 ts_manager.cc:194] Registered new tserver with Master: 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495)
I20260808 18:41:21.120352 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:59083
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:41:21.139356 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:21.249100 26138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:21.249343 26138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:21.249384 26138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:21.253257 26138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:21.253309 26138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:21.253364 26138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:21.258481 26138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:21.259498 26138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:21.260471 26138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:21.269815 26144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:21.269850 26143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:21.269791 26147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:21.270035 26138 server_base.cc:1034] running on GCE node
I20260808 18:41:21.270473 26138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:21.271081 26138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:21.272274 26138 hybrid_clock.cc:648] HybridClock initialized: now 1786214481272254 us; error 29 us; skew 500 ppm
Aug 08 18:41:21 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:21.274896 26138 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:21.275715 26138 webserver.cc:460] Webserver started at http://127.4.61.195:38927/ using document root <none> and password file <none>
I20260808 18:41:21.276281 26138 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:21.276345 26138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:21.276543 26138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:21.278617 26138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "026b42b82108463987068ddcbf8b829d"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "778b1af6891f665ce2904c421ddf78b5"
server_key_iv: "f28ba0d6c5f8649d7beb5b802b2b4454"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.279184 26138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "026b42b82108463987068ddcbf8b829d"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "778b1af6891f665ce2904c421ddf78b5"
server_key_iv: "f28ba0d6c5f8649d7beb5b802b2b4454"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.282884 26138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:41:21.285264 26158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.286525 26138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:21.286626 26138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "026b42b82108463987068ddcbf8b829d"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "778b1af6891f665ce2904c421ddf78b5"
server_key_iv: "f28ba0d6c5f8649d7beb5b802b2b4454"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.286726 26138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:21.303960 26138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:21.306840 26138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:21.307024 26138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:21.307636 26138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:21.308519 26138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:21.308573 26138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.308615 26138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:21.308645 26138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.319303 26138 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45819
I20260808 18:41:21.319320 26339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45819 every 8 connection(s)
I20260808 18:41:21.320535 26138 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:21.325850 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 26138
I20260808 18:41:21.325986 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:41:21.326246 4343 external_mini_cluster.cc:1428] Setting key 5da130dca3354c76c8ba666837f5529f
Aug 08 18:41:21 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:21.333761 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.322602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:46979 (local address 127.4.61.254:36383)
0808 18:41:21.322740 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.322744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.323749 (+ 1005us) server_negotiation.cc:407] Connection header received
0808 18:41:21.324617 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.324620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.324667 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.324740 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:21.325962 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.326632 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.328093 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.328390 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.328472 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.330783 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:21.330786 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:21.330789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:21.330814 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:21.332184 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.332588 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.332590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.332591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.332659 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.332902 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.332904 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.332905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.333064 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:21.333131 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.333537 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.333632 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:41:21.334599 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.322987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:46979)
0808 18:41:21.323621 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.323663 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.324430 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.324888 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.324895 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.325255 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:21.325804 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.325826 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.326769 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.326773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.327979 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.327990 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.328521 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.328524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.328675 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.329179 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:21.329195 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:21.330620 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:21.332270 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:21.332274 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:21.332285 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:21.332519 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:21.332718 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:21.332720 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:21.332722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:21.332840 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:21.333131 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:21.333135 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:21.333359 (+ 224us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.333506 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.333746 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":107,"threads_started":1}
I20260808 18:41:21.335667 26340 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:21.335891 26340 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:21.336371 26340 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
I20260808 18:41:21.337420 25634 ts_manager.cc:194] Registered new tserver with Master: 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
I20260808 18:41:21.337989 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:46979
I20260808 18:41:21.340051 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:41:21.348481 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.341955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.4.61.254:36383)
0808 18:41:21.342080 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.342085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.342238 (+ 153us) server_negotiation.cc:407] Connection header received
0808 18:41:21.342368 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.342370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.342409 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.342499 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:21.343135 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.343692 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.344482 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.344680 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.344746 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.345884 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:21.345887 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:21.345889 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:21.345909 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:21.347189 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.347548 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.347550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.347551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.347613 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:21.347786 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:21.347788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:21.347789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:21.347985 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:21.348080 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.348229 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.348328 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:41:21.350993 25634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:41:21.353870 25634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:41:21.367619 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.362689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.0.0.1:51960)
0808 18:41:21.363162 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.363175 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.363264 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.363788 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.363791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.363809 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:21.363894 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.363900 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.365178 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.365180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.366179 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.366189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.367083 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.367086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.367193 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.367229 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.367340 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.367468 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":29,"thread_start_us":92,"threads_started":1}
I20260808 18:41:21.367628 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.362968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51960 (local address 127.4.61.195:45819)
0808 18:41:21.363353 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.363363 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.363384 (+ 21us) server_negotiation.cc:407] Connection header received
0808 18:41:21.363447 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.363450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.363624 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.363769 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:21.364023 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.365058 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.366355 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.366968 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.367070 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.367230 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.367379 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.367472 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":82,"threads_started":1}
I20260808 18:41:21.368085 26358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.361964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:35247 (local address 127.0.0.1:40934)
0808 18:41:21.362451 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.362499 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.362625 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.363416 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.363422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.363444 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:21.363574 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.363581 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.364972 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.364976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.366388 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.366399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.367688 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.367692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.367782 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.367805 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.367876 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.367948 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":40,"thread_start_us":81,"threads_started":1}
I20260808 18:41:21.368475 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.362916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40495 (local address 127.0.0.1:43252)
0808 18:41:21.364008 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.364020 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.364104 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.364464 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.364467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.364485 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:21.364581 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.364588 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.365879 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.365883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.366999 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.367009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.368038 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.368042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.368128 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.368152 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.368235 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.368359 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1030,"thread_start_us":103,"threads_started":1}
I20260808 18:41:21.368505 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.362084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40934 (local address 127.4.61.193:35247)
0808 18:41:21.362664 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.362682 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.362707 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:41:21.362790 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.362795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.363008 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.363179 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:21.363708 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.364828 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.366540 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.367376 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.367488 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.367621 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.368250 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.368352 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":93,"threads_started":1}
I20260808 18:41:21.368505 26362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.362551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43252 (local address 127.4.61.194:40495)
0808 18:41:21.363708 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.363722 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.364103 (+ 381us) server_negotiation.cc:407] Connection header received
0808 18:41:21.364206 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.364210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.364342 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.364477 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:21.364672 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.365706 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.367139 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.367904 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.368024 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.368162 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.368304 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.368382 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1057,"thread_start_us":152,"threads_started":1}
I20260808 18:41:21.371084 26222 tablet_service.cc:1467] Processing CreateTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 (DEFAULT_TABLE table=test-table [id=085b8de68d114cd7b46fea018d017d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:21.371337 25829 tablet_service.cc:1467] Processing CreateTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 (DEFAULT_TABLE table=test-table [id=085b8de68d114cd7b46fea018d017d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:21.371333 26030 tablet_service.cc:1467] Processing CreateTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 (DEFAULT_TABLE table=test-table [id=085b8de68d114cd7b46fea018d017d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:21.372136 26222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1267de8e6bd04e36b0ee341bf42d7798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:21.372373 26030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1267de8e6bd04e36b0ee341bf42d7798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:21.372375 25829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1267de8e6bd04e36b0ee341bf42d7798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:21.379132 26367 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Bootstrap starting.
I20260808 18:41:21.379913 26369 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Bootstrap starting.
I20260808 18:41:21.381438 26367 tablet_bootstrap.cc:654] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:21.381954 26369 tablet_bootstrap.cc:654] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:21.382524 26367 log.cc:824] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:21.382673 26369 log.cc:824] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:21.383193 26368 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap starting.
I20260808 18:41:21.384582 26369 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: No bootstrap required, opened a new log
I20260808 18:41:21.384582 26367 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: No bootstrap required, opened a new log
I20260808 18:41:21.384809 26369 ts_tablet_manager.cc:1397] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:21.384838 26367 ts_tablet_manager.cc:1397] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 18:41:21.385190 26368 tablet_bootstrap.cc:654] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:21.386128 26368 log.cc:824] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:21.387826 26368 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: No bootstrap required, opened a new log
I20260808 18:41:21.388008 26368 ts_tablet_manager.cc:1397] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:41:21.388783 26369 raft_consensus.cc:348] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.388783 26367 raft_consensus.cc:348] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.389076 26367 raft_consensus.cc:374] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:21.389076 26369 raft_consensus.cc:374] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:21.389147 26369 raft_consensus.cc:729] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29706d568f374e5b943ff589be818c96, State: Initialized, Role: FOLLOWER
I20260808 18:41:21.389173 26367 raft_consensus.cc:729] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026b42b82108463987068ddcbf8b829d, State: Initialized, Role: FOLLOWER
I20260808 18:41:21.389650 26367 consensus_queue.cc:260] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.389650 26369 consensus_queue.cc:260] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.390748 26367 ts_tablet_manager.cc:1428] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260808 18:41:21.390736 26369 ts_tablet_manager.cc:1428] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:41:21.391124 26131 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
I20260808 18:41:21.391422 26340 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
I20260808 18:41:21.391405 26368 raft_consensus.cc:348] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.391654 26368 raft_consensus.cc:374] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:21.391700 26368 raft_consensus.cc:729] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Initialized, Role: FOLLOWER
I20260808 18:41:21.392109 26368 consensus_queue.cc:260] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.392768 25918 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
I20260808 18:41:21.393049 26368 ts_tablet_manager.cc:1428] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260808 18:41:21.571605 26341 tablet.cc:2369] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:41:21.602512 26134 tablet.cc:2369] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:41:21.621909 25919 tablet.cc:2369] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:21.650938 26382 raft_consensus.cc:482] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:21.651192 26382 raft_consensus.cc:504] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.652395 26382 leader_election.cc:288] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819), 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495)
I20260808 18:41:21.656404 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.652778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:48125 (local address 127.4.61.195:45819)
0808 18:41:21.652928 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.652932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.653245 (+ 313us) server_negotiation.cc:407] Connection header received
0808 18:41:21.653368 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.653370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.653414 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.653488 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:21.653769 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.654260 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655460 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.655849 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655956 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.656009 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.656203 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.656277 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 18:41:21.656427 26362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.652779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:35019 (local address 127.4.61.194:40495)
0808 18:41:21.652911 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.652916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.653205 (+ 289us) server_negotiation.cc:407] Connection header received
0808 18:41:21.653349 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.653353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.653402 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.653463 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:21.653765 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.654261 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655458 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.655844 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655946 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.656003 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.656216 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.656285 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:41:21.656442 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.652681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.4.61.193:48125)
0808 18:41:21.653137 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.653150 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.653263 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.653507 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.653510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.653526 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:21.653662 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.653667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.654375 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.654379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.655330 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.655339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.655973 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.656078 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.656105 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.656168 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.656237 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":212,"thread_start_us":113,"threads_started":1}
I20260808 18:41:21.656450 26383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.652680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40495 (local address 127.4.61.193:35019)
0808 18:41:21.653101 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.653113 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:21.653223 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:21.653500 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:21.653502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:21.653517 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:21.653654 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.653659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.654400 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.654403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.655332 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:21.655342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.655975 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.655979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:21.656098 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.656117 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:41:21.656185 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:41:21.656256 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":35,"spinlock_wait_cycles":16256,"thread_start_us":125,"threads_started":1}
I20260808 18:41:21.657182 26262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1267de8e6bd04e36b0ee341bf42d7798" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d" is_pre_election: true
I20260808 18:41:21.657225 26059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1267de8e6bd04e36b0ee341bf42d7798" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29706d568f374e5b943ff589be818c96" is_pre_election: true
I20260808 18:41:21.657521 26262 raft_consensus.cc:2454] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 0.
I20260808 18:41:21.657521 26059 raft_consensus.cc:2454] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 0.
I20260808 18:41:21.658011 25758 leader_election.cc:302] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29706d568f374e5b943ff589be818c96, d9f68471179e441a9d1b836e0e65a6c3; no voters:
I20260808 18:41:21.658301 26382 raft_consensus.cc:2781] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:21.658423 26382 raft_consensus.cc:482] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:21.658478 26382 raft_consensus.cc:3037] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:21.659595 26382 raft_consensus.cc:504] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.659930 26382 leader_election.cc:288] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 election: Requested vote from peers 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819), 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495)
I20260808 18:41:21.660291 26262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1267de8e6bd04e36b0ee341bf42d7798" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d"
I20260808 18:41:21.660295 26059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1267de8e6bd04e36b0ee341bf42d7798" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29706d568f374e5b943ff589be818c96"
I20260808 18:41:21.660416 26262 raft_consensus.cc:3037] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:21.660416 26059 raft_consensus.cc:3037] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:21.661664 26059 raft_consensus.cc:2454] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 1.
I20260808 18:41:21.661685 26262 raft_consensus.cc:2454] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 1.
I20260808 18:41:21.661943 25761 leader_election.cc:302] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026b42b82108463987068ddcbf8b829d, d9f68471179e441a9d1b836e0e65a6c3; no voters:
I20260808 18:41:21.662128 26382 raft_consensus.cc:2781] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:21.662366 26382 raft_consensus.cc:686] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 LEADER]: Becoming Leader. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Running, Role: LEADER
I20260808 18:41:21.662684 26382 consensus_queue.cc:237] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:21.665822 25631 catalog_manager.cc:5495] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "d9f68471179e441a9d1b836e0e65a6c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } health_report { overall_health: UNKNOWN } } }
I20260808 18:41:21.736326 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.733197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40948 (local address 127.4.61.193:35247)
0808 18:41:21.733320 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:21.733324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:21.733337 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:41:21.733418 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:21.733420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:21.733489 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:21.733576 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:41:21.733775 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.734268 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.735088 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:21.735297 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:21.735369 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:21.735613 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:41:21.736042 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:41:21.736130 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:21.736159 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 18:41:21.736212 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:41:21.742507 26262 raft_consensus.cc:1261] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Refusing update from remote peer d9f68471179e441a9d1b836e0e65a6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:21.742491 26059 raft_consensus.cc:1261] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Refusing update from remote peer d9f68471179e441a9d1b836e0e65a6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:21.743286 26382 consensus_queue.cc:1035] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:21.743506 26386 consensus_queue.cc:1035] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:21.750782 26392 mvcc.cc:205] Tried to move back new op lower bound from 7316334517209784320 to 7316334516892987392. Current Snapshot: MvccSnapshot[applied={T|T < 7316334517209784320}]
I20260808 18:41:21.758499 26394 mvcc.cc:205] Tried to move back new op lower bound from 7316334517209784320 to 7316334516892987392. Current Snapshot: MvccSnapshot[applied={T|T < 7316334517209784320 or (T in {7316334517209784320})}]
I20260808 18:41:21.759502 25632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:21.759688 25632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:21.762212 25632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Sending DeleteTablet for 3 replicas of tablet 1267de8e6bd04e36b0ee341bf42d7798
I20260808 18:41:21.763070 26030 tablet_service.cc:1514] Processing DeleteTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:21 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43252
I20260808 18:41:21.763070 26222 tablet_service.cc:1514] Processing DeleteTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:21 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51960
I20260808 18:41:21.763091 25829 tablet_service.cc:1514] Processing DeleteTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:21 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:40934
I20260808 18:41:21.763619 26408 tablet_replica.cc:330] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: stopping tablet replica
I20260808 18:41:21.763619 26407 tablet_replica.cc:330] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: stopping tablet replica
I20260808 18:41:21.763782 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25724
I20260808 18:41:21.763934 26408 raft_consensus.cc:2229] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:21.763950 26407 raft_consensus.cc:2229] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:41:21.764251 26408 raft_consensus.cc:2258] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:21.766531 26406 tablet_replica.cc:330] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: stopping tablet replica
I20260808 18:41:21.766800 26406 raft_consensus.cc:2229] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:21.767040 26406 raft_consensus.cc:2258] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:21.771461 26406 ts_tablet_manager.cc:1905] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:21.771844 26408 ts_tablet_manager.cc:1905] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:21.774381 26406 ts_tablet_manager.cc:1918] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:21.774425 26408 ts_tablet_manager.cc:1918] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:21.774511 26408 log.cc:1196] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/1267de8e6bd04e36b0ee341bf42d7798
I20260808 18:41:21.774536 26406 log.cc:1196] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/1267de8e6bd04e36b0ee341bf42d7798
I20260808 18:41:21.774856 26408 ts_tablet_manager.cc:1939] T 1267de8e6bd04e36b0ee341bf42d7798 P 29706d568f374e5b943ff589be818c96: Deleting consensus metadata
I20260808 18:41:21.774864 26406 ts_tablet_manager.cc:1939] T 1267de8e6bd04e36b0ee341bf42d7798 P 026b42b82108463987068ddcbf8b829d: Deleting consensus metadata
I20260808 18:41:21.776227 25613 catalog_manager.cc:4841] TS 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): tablet 1267de8e6bd04e36b0ee341bf42d7798 (table test-table [id=085b8de68d114cd7b46fea018d017d11]) successfully deleted
I20260808 18:41:21.778527 25614 catalog_manager.cc:4841] TS 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): tablet 1267de8e6bd04e36b0ee341bf42d7798 (table test-table [id=085b8de68d114cd7b46fea018d017d11]) successfully deleted
W20260808 18:41:21.782008 25614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:35247 (error 108)
I20260808 18:41:21.782282 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25924
I20260808 18:41:21.792274 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:21.791486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:35247 (local address 127.0.0.1:40958)
0808 18:41:21.792087 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:21.792173 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506}
W20260808 18:41:21.792609 25614 catalog_manager.cc:4584] TS d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1267de8e6bd04e36b0ee341bf42d7798: Network error: Client connection negotiation failed: client connection to 127.4.61.193:35247: connect: Connection refused (error 111)
I20260808 18:41:21.802459 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 26138
I20260808 18:41:21.811187 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 25583
I20260808 18:41:21.825851 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--webserver_interface=127.4.61.254
--webserver_port=44585
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:21.936122 26412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:21.936383 26412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:21.936427 26412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:21.940420 26412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:21.940471 26412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:21.940490 26412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:21.940517 26412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:21.940544 26412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:21.945591 26412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=44585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:21.946599 26412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:21.947562 26412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:21.962564 26420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:21.962564 26423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:21.962566 26412 server_base.cc:1034] running on GCE node
W20260808 18:41:21.962581 26421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:21.963336 26412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:21.964391 26412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:21.965547 26412 hybrid_clock.cc:648] HybridClock initialized: now 1786214481965511 us; error 47 us; skew 500 ppm
Aug 08 18:41:21 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:21.968293 26412 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:21.969128 26412 webserver.cc:460] Webserver started at http://127.4.61.254:44585/ using document root <none> and password file <none>
I20260808 18:41:21.969683 26412 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:21.969760 26412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:21.973663 26412 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260808 18:41:21.975872 26436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:21.977087 26412 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:21.977196 26412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "89f2e6b87bbd44069d6012cb2269c066"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "6a72fe0697d28ebee9bcdcbc7fccfeb8"
server_key_iv: "aca499f8fe77be5cfcf4d52a7cf7246d"
server_key_version: "encryptionkey@0"
I20260808 18:41:21.977810 26412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:21.993362 26412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:21.996276 26412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:21.996445 26412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:22.003404 26412 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:36383
I20260808 18:41:22.003670 26532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:36383 every 8 connection(s)
I20260808 18:41:22.004496 26412 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:22.008888 26534 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:41:22.010645 26534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap starting.
I20260808 18:41:22.012137 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 26412
I20260808 18:41:22.012537 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:35247
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=41979
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:22.032423 26534 log.cc:824] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:22.044281 26534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:41:22.044754 26534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap complete.
I20260808 18:41:22.050357 26534 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:22.050890 26534 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Initialized, Role: FOLLOWER
I20260808 18:41:22.051466 26534 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:22.051621 26534 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:22.051695 26534 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:22.051802 26534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:41:22.054347 26534 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:22.054790 26534 leader_election.cc:302] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89f2e6b87bbd44069d6012cb2269c066; no voters:
I20260808 18:41:22.055109 26534 leader_election.cc:288] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 18:41:22.055222 26538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 18:41:22.055477 26538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 LEADER]: Becoming Leader. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Running, Role: LEADER
I20260808 18:41:22.055873 26538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:22.056411 26534 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:22.057543 26541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89f2e6b87bbd44069d6012cb2269c066. Latest consensus state: current_term: 2 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:22.057572 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:22.057667 26541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:22.057675 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:22.058584 26554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:22.063742 26554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:22.064368 26554 catalog_manager.cc:1259] Loaded cluster ID: ea30c33e33384a41ae63769a87bdb4ee
I20260808 18:41:22.064433 26554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:22.065855 26554 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 18:41:22.070236 26554 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 18:41:22.075925 26554 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:22.076718 26554 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Loaded TSK: 0
I20260808 18:41:22.077987 26554 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:41:22.145459 26536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:22.145713 26536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:22.145756 26536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:22.149735 26536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:22.149796 26536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:22.149875 26536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:22.155213 26536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:35247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=41979
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:22.156188 26536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:22.157220 26536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:22.166836 26573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.166957 26577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.166846 26572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:22.167177 26536 server_base.cc:1034] running on GCE node
I20260808 18:41:22.167654 26536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:22.168444 26536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:22.169658 26536 hybrid_clock.cc:648] HybridClock initialized: now 1786214482169635 us; error 33 us; skew 500 ppm
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:22.173060 26536 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:22.174073 26536 webserver.cc:460] Webserver started at http://127.4.61.193:41979/ using document root <none> and password file <none>
I20260808 18:41:22.174736 26536 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:22.174825 26536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:22.179545 26536 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:41:22.182168 26590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.183751 26536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:22.183876 26536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "d9f68471179e441a9d1b836e0e65a6c3"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "67edbb20608e56726015584c43cc6059"
server_key_iv: "386be84c822ea8114c6883d50290af3e"
server_key_version: "encryptionkey@0"
I20260808 18:41:22.184597 26536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:22.200212 26536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:22.204020 26536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:22.204244 26536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:22.204983 26536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:22.206148 26602 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 18:41:22.210578 26536 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 18:41:22.210661 26536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 18:41:22.210747 26536 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 18:41:22.212559 26536 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 18:41:22.212612 26536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 18:41:22.212999 26602 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap starting.
I20260808 18:41:22.222959 26536 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:35247
I20260808 18:41:22.223019 26783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:35247 every 8 connection(s)
I20260808 18:41:22.223951 26536 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:22.231252 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 26536
I20260808 18:41:22.232131 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:40495
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=43957
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:22.232442 26602 log.cc:824] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:22.241155 26602 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:41:22.241644 26602 tablet_bootstrap.cc:492] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap complete.
I20260808 18:41:22.243014 26602 ts_tablet_manager.cc:1397] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.009s
I20260808 18:41:22.243395 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.225844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:54001)
0808 18:41:22.226448 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.226508 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.227595 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.228805 (+ 1210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.228814 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.229325 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:22.230062 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.230086 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.231855 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.231858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.232941 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.232953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.234195 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.234199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.234420 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.235061 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:22.235082 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:22.237101 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:22.239785 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.239791 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.239804 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.240149 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.240557 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.240561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.240563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.240732 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.241575 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:22.241582 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:22.241883 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.242075 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.242438 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":143,"threads_started":1}
I20260808 18:41:22.243737 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.226016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:54001 (local address 127.4.61.254:36383)
0808 18:41:22.226521 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.226540 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.226616 (+ 76us) server_negotiation.cc:407] Connection header received
0808 18:41:22.228026 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.228042 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.228371 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.228634 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:22.230278 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.231671 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.233082 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.233843 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.233997 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.237334 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:22.237342 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:22.237359 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:22.237396 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:22.239646 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.240268 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.240275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.240281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.240452 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.240838 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.240842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.240844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.241446 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:22.241594 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.242233 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.242596 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":115,"threads_started":1}
I20260808 18:41:22.245950 26602 raft_consensus.cc:348] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:22.246483 26602 raft_consensus.cc:729] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Initialized, Role: FOLLOWER
I20260808 18:41:22.246532 26784 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:22.246771 26784 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:22.246975 26602 consensus_queue.cc:260] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } }
I20260808 18:41:22.247339 26784 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
I20260808 18:41:22.248025 26602 ts_tablet_manager.cc:1428] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260808 18:41:22.249917 26464 ts_manager.cc:194] Registered new tserver with Master: d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247)
I20260808 18:41:22.253372 26464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:54001
I20260808 18:41:22.255771 26784 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214481, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:41:22.263504 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.252739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:35247 (local address 127.0.0.1:40966)
0808 18:41:22.253485 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.253532 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.253671 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.254241 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.254247 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.254691 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:22.254831 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.254840 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.256082 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.256086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.257088 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.257100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.257887 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.257890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.257992 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.258562 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:22.258599 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:22.260069 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:22.261964 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.261973 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.261977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.262185 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.262497 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.262500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.262501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.262576 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.263033 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:22.263038 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:22.263131 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.263234 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.263377 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":108,"threads_started":1}
I20260808 18:41:22.263657 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.252852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40966 (local address 127.4.61.193:35247)
0808 18:41:22.253223 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.253233 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.253630 (+ 397us) server_negotiation.cc:407] Connection header received
0808 18:41:22.253847 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.253853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.254052 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.254182 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:22.254964 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.255963 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.257257 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.257774 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.257882 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.260203 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:22.260213 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:22.260226 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:22.260252 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:22.261866 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.262286 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.262293 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.262294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.262418 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.262650 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.262653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.262655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.262939 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:22.263065 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.263331 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.263500 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":105,"threads_started":1}
I20260808 18:41:22.264770 26670 tablet_service.cc:1514] Processing DeleteTablet for tablet 1267de8e6bd04e36b0ee341bf42d7798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:21 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:40966
I20260808 18:41:22.265597 26798 tablet_replica.cc:330] stopping tablet replica
I20260808 18:41:22.265919 26798 raft_consensus.cc:2229] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:22.266167 26798 raft_consensus.cc:2258] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:22.267266 26798 ts_tablet_manager.cc:1905] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:22.271874 26798 ts_tablet_manager.cc:1918] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:22.271986 26798 log.cc:1196] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/1267de8e6bd04e36b0ee341bf42d7798
I20260808 18:41:22.272261 26798 ts_tablet_manager.cc:1939] T 1267de8e6bd04e36b0ee341bf42d7798 P d9f68471179e441a9d1b836e0e65a6c3: Deleting consensus metadata
I20260808 18:41:22.274289 26442 catalog_manager.cc:4841] TS d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247): tablet 1267de8e6bd04e36b0ee341bf42d7798 (table test-table [id=085b8de68d114cd7b46fea018d017d11]) successfully deleted
W20260808 18:41:22.353389 26791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:22.353647 26791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:22.353706 26791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:22.357610 26791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:22.357674 26791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:22.357754 26791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:22.363085 26791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:40495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=43957
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:22.364136 26791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:22.365134 26791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:22.374646 26809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.374621 26804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.374643 26805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:22.374831 26791 server_base.cc:1034] running on GCE node
I20260808 18:41:22.375305 26791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:22.375890 26791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:22.377046 26791 hybrid_clock.cc:648] HybridClock initialized: now 1786214482377017 us; error 38 us; skew 500 ppm
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:22.383601 26791 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:22.384464 26791 webserver.cc:460] Webserver started at http://127.4.61.194:43957/ using document root <none> and password file <none>
I20260808 18:41:22.384987 26791 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:22.385066 26791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:22.388774 26791 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:22.390791 26823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.391923 26791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:22.392019 26791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "29706d568f374e5b943ff589be818c96"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "cae2195a1d1a33ccfd6121dedcc0ea18"
server_key_iv: "04ce0b378c3f9e68e18e89f2a17328b4"
server_key_version: "encryptionkey@0"
I20260808 18:41:22.392530 26791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:22.406932 26791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:22.409497 26791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:22.409662 26791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:22.410223 26791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:22.411070 26791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:22.411118 26791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.411157 26791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:22.411186 26791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.419914 26791 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:40495
I20260808 18:41:22.419945 27004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:40495 every 8 connection(s)
I20260808 18:41:22.420976 26791 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:22.430768 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 26791
I20260808 18:41:22.431243 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:45819
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=38927
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:22.435562 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.422774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:53715 (local address 127.4.61.254:36383)
0808 18:41:22.422924 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.422928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.423929 (+ 1001us) server_negotiation.cc:407] Connection header received
0808 18:41:22.424758 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.424761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.424813 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.424885 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:22.426074 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.426649 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.428200 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.428556 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.428671 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.431380 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:22.431384 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:22.431386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:22.431414 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:22.433079 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.433698 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.433703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.433705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.433832 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.434231 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.434235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.434237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.434504 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:22.434600 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.435223 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.435368 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:41:22.436797 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.423153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:53715)
0808 18:41:22.423791 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.423832 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.424584 (+ 752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.425097 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.425104 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.425466 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:22.425937 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.425952 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.426776 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.426780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.428044 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.428058 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.428717 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.428721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.428912 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.429498 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:22.429515 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:22.431201 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:22.433219 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.433225 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.433241 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.433579 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.433942 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.433945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.433947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.434124 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.434618 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:22.434625 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:22.434952 (+ 327us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.435155 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.435496 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":112,"threads_started":1}
I20260808 18:41:22.438030 27005 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:22.438273 27005 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:22.438846 27005 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
I20260808 18:41:22.440011 26464 ts_manager.cc:194] Registered new tserver with Master: 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495)
I20260808 18:41:22.440667 26464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:53715
W20260808 18:41:22.553370 27008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:22.553730 27008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:22.553781 27008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:22.559562 27008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:22.559645 27008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:22.559736 27008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:22.567178 27008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:45819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=38927
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:22.568661 27008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:22.570070 27008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:22.581853 27014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.581854 27013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:22.581854 27016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:22.582520 27008 server_base.cc:1034] running on GCE node
I20260808 18:41:22.583084 27008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:22.583837 27008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:22.584992 27008 hybrid_clock.cc:648] HybridClock initialized: now 1786214482584959 us; error 45 us; skew 500 ppm
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:22.587680 27008 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:22.588619 27008 webserver.cc:460] Webserver started at http://127.4.61.195:38927/ using document root <none> and password file <none>
I20260808 18:41:22.589228 27008 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:22.589321 27008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:22.593370 27008 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:41:22.595518 27027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.596853 27008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:22.596971 27008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "026b42b82108463987068ddcbf8b829d"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "778b1af6891f665ce2904c421ddf78b5"
server_key_iv: "f28ba0d6c5f8649d7beb5b802b2b4454"
server_key_version: "encryptionkey@0"
I20260808 18:41:22.597548 27008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:22.619269 27008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:22.622536 27008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:22.622735 27008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:22.623374 27008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:22.624275 27008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:22.624326 27008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.624383 27008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:22.624411 27008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:22.633663 27008 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45819
I20260808 18:41:22.633755 27213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45819 every 8 connection(s)
I20260808 18:41:22.634783 27008 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:22.639832 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 27008
Aug 08 18:41:22 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214482, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:22.648463 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.640496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47770 (local address 127.4.61.254:36383)
0808 18:41:22.641194 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.641198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.641209 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:41:22.641255 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.641257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.641301 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.641391 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:22.642082 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.642703 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.643747 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.644085 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.644199 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.645466 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:22.645469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:22.645471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:22.645493 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:22.646897 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647286 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.647290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.647291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.647368 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647614 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.647618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.647620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.647791 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:22.648003 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.648175 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.648293 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":70,"threads_started":1}
I20260808 18:41:22.649012 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.636651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:43621 (local address 127.4.61.254:36383)
0808 18:41:22.636797 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.636802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.637989 (+ 1187us) server_negotiation.cc:407] Connection header received
0808 18:41:22.638951 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.638954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.639002 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.639067 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:22.640306 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.640931 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.642393 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.642762 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.642886 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.645646 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:22.645649 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:22.645651 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:22.645688 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:22.647042 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647527 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.647531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.647532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.647605 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647924 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:22.647927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:22.647929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:22.648104 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:22.648187 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.648773 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.648879 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:41:22.650130 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.637075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:43621)
0808 18:41:22.637824 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.637866 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.638725 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.639232 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.639241 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.639595 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:22.640150 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.640168 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.641076 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.641079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.642243 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.642254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.642927 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.642930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.643076 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.643759 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:22.643780 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:22.645497 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:22.647149 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.647172 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.647434 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.647686 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:22.647690 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:22.647692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:22.647831 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:22.648207 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:22.648213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:22.648506 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.648721 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.649073 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":119,"threads_started":1}
I20260808 18:41:22.651245 27214 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36383
I20260808 18:41:22.651495 27214 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:22.651996 27214 heartbeater.cc:511] Master 127.4.61.254:36383 requested a full tablet report, sending...
I20260808 18:41:22.652983 26464 ts_manager.cc:194] Registered new tserver with Master: 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
I20260808 18:41:22.653534 26464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:43621
I20260808 18:41:22.662046 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:41:22.665900 26788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.662680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47776 (local address 127.4.61.254:36383)
0808 18:41:22.662803 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.662807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.662990 (+ 183us) server_negotiation.cc:407] Connection header received
0808 18:41:22.663124 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.663126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.663223 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.663306 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:41:22.663485 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.663982 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.664762 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.664966 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.665032 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.665242 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:41:22.665622 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:41:22.665706 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.665730 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.665774 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:41:22.666522 26464 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:41:22.669667 26464 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:41:22.677322 26670 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbe3a6416f4f0f98b77e26010a26bd (DEFAULT_TABLE table=test-table [id=c264c1f7a53a4ad18832858cb9fb045e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:22.678043 26670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fbe3a6416f4f0f98b77e26010a26bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:22.680830 26602 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap starting.
I20260808 18:41:22.681648 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.676054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40495 (local address 127.0.0.1:43254)
0808 18:41:22.676210 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.676224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.676296 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.677219 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.677222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.677240 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.677354 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.677362 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.678852 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.678856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.680029 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.680041 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.681159 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.681163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.681286 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.681340 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.681406 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.681487 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":18}
I20260808 18:41:22.681742 26602 tablet_bootstrap.cc:654] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:22.681937 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.676339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.0.0.1:51966)
0808 18:41:22.676612 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.676625 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.676715 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.677445 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.677449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.677468 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.677551 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.677557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.679162 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.679165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.679937 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.679947 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.681159 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.681163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.681648 (+ 485us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.681673 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.681741 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.681809 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":373,"thread_start_us":101,"threads_started":1}
I20260808 18:41:22.682384 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.676552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.4.61.195:45819)
0808 18:41:22.676954 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.676966 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.676989 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:41:22.677063 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.677068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.677259 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.677463 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.677697 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.679025 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.680061 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.681026 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.681229 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.681519 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.682108 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.682216 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":134,"threads_started":1}
I20260808 18:41:22.682384 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.676330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43254 (local address 127.4.61.194:40495)
0808 18:41:22.676769 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.676782 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.676806 (+ 24us) server_negotiation.cc:407] Connection header received
0808 18:41:22.676896 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.676902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.677073 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.677223 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.677482 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.678716 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.680168 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.681026 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.681787 (+ 761us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.681982 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.682144 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.682231 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":96,"threads_started":1}
I20260808 18:41:22.683771 26602 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: No bootstrap required, opened a new log
I20260808 18:41:22.683857 26602 ts_tablet_manager.cc:1397] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 18:41:22.684284 26602 raft_consensus.cc:348] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.684383 26602 raft_consensus.cc:374] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:22.684422 26602 raft_consensus.cc:729] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Initialized, Role: FOLLOWER
I20260808 18:41:22.684547 26602 consensus_queue.cc:260] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.684918 26602 ts_tablet_manager.cc:1428] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 18:41:22.685724 27112 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbe3a6416f4f0f98b77e26010a26bd (DEFAULT_TABLE table=test-table [id=c264c1f7a53a4ad18832858cb9fb045e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:22.685720 26889 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbe3a6416f4f0f98b77e26010a26bd (DEFAULT_TABLE table=test-table [id=c264c1f7a53a4ad18832858cb9fb045e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:22.686892 26889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fbe3a6416f4f0f98b77e26010a26bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:22.686897 27112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43fbe3a6416f4f0f98b77e26010a26bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:22.695528 27234 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Bootstrap starting.
I20260808 18:41:22.695139 27233 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Bootstrap starting.
I20260808 18:41:22.697922 27233 tablet_bootstrap.cc:654] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:22.697921 27234 tablet_bootstrap.cc:654] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:22.698725 27234 log.cc:824] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:22.698725 27233 log.cc:824] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:22.700726 27233 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: No bootstrap required, opened a new log
I20260808 18:41:22.700727 27234 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: No bootstrap required, opened a new log
I20260808 18:41:22.700937 27233 ts_tablet_manager.cc:1397] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:41:22.700945 27234 ts_tablet_manager.cc:1397] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:41:22.703936 27233 raft_consensus.cc:348] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.703945 27234 raft_consensus.cc:348] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.704170 27234 raft_consensus.cc:374] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:22.704176 27233 raft_consensus.cc:374] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:22.704205 27234 raft_consensus.cc:729] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026b42b82108463987068ddcbf8b829d, State: Initialized, Role: FOLLOWER
I20260808 18:41:22.704241 27233 raft_consensus.cc:729] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29706d568f374e5b943ff589be818c96, State: Initialized, Role: FOLLOWER
I20260808 18:41:22.704629 27233 consensus_queue.cc:260] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.704629 27234 consensus_queue.cc:260] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.705307 27005 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
I20260808 18:41:22.705543 27234 ts_tablet_manager.cc:1428] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:22.705559 27233 ts_tablet_manager.cc:1428] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:22.705758 27214 heartbeater.cc:503] Master 127.4.61.254:36383 was elected leader, sending a full tablet report...
W20260808 18:41:22.725323 26785 tablet.cc:2369] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:22.856985 26792 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:22.857250 26792 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.858510 27238 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:22.858592 26792 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
I20260808 18:41:22.858729 27238 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.860065 27238 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819), d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247)
I20260808 18:41:22.863314 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.858875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:56179 (local address 127.4.61.194:40495)
0808 18:41:22.858999 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.859004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.859333 (+ 329us) server_negotiation.cc:407] Connection header received
0808 18:41:22.859514 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.859518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.859572 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.859640 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.859921 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.860623 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.862041 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.862644 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.862723 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.862772 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.863112 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.863179 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:41:22.863706 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.858787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40495 (local address 127.4.61.193:56179)
0808 18:41:22.859210 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.859225 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.859377 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.859649 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.859651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.859667 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.859765 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.859772 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.860748 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.860752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.861916 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.861926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.862861 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.862864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.862948 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.862995 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.863484 (+ 489us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.863560 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":88,"threads_started":1}
I20260808 18:41:22.863833 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.859028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:60185 (local address 127.4.61.195:45819)
0808 18:41:22.859157 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.859162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.859358 (+ 196us) server_negotiation.cc:407] Connection header received
0808 18:41:22.859603 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.859606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.859660 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.859735 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.859984 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.860697 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.862486 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.863190 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.863285 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.863332 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.863630 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.863703 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":42}
I20260808 18:41:22.864544 26920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29706d568f374e5b943ff589be818c96" is_pre_election: true
I20260808 18:41:22.864773 26920 raft_consensus.cc:2454] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 0.
I20260808 18:41:22.865061 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.858787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.4.61.193:60185)
0808 18:41:22.859277 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.859289 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.859430 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.859765 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.859767 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.859781 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.859846 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.859852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.860822 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.860825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.862164 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.862214 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.863404 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.863407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.863506 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.863527 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.864215 (+ 688us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.864942 (+ 727us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":710,"thread_start_us":52,"threads_started":1}
I20260808 18:41:22.865356 26592 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29706d568f374e5b943ff589be818c96, d9f68471179e441a9d1b836e0e65a6c3; no voters:
I20260808 18:41:22.865800 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.860208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.4.61.194:37473)
0808 18:41:22.860322 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.860335 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.860411 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.861314 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.861317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.861335 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.861432 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.861437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.863632 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.863635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.864597 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.864608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.865403 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.865407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.865527 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.865550 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.865609 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.865679 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":16}
I20260808 18:41:22.865772 26792 raft_consensus.cc:2781] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:22.865854 26792 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:22.865895 26792 raft_consensus.cc:3037] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:22.866114 27147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d" is_pre_election: true
I20260808 18:41:22.866384 27242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.860423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:35247 (local address 127.4.61.194:33589)
0808 18:41:22.860970 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.860984 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:22.861065 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:22.861496 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:22.861499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:22.861516 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:22.861616 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.861621 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.862571 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.862574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.864052 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:22.864063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.865484 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.865488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:22.866096 (+ 608us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.866115 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:41:22.866178 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 18:41:22.866236 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":2,"thread_start_us":119,"threads_started":1}
I20260808 18:41:22.866402 27147 raft_consensus.cc:2454] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 0.
I20260808 18:41:22.865824 27244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.860594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:37473 (local address 127.4.61.195:45819)
0808 18:41:22.861083 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.861091 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.861104 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:41:22.861148 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.861150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.861192 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.861524 (+ 332us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.862799 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.863513 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.864737 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.865279 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.865553 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.865598 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.865634 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.865693 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":423,"thread_start_us":144,"threads_started":1}
I20260808 18:41:22.866752 27246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.860778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:33589 (local address 127.4.61.193:35247)
0808 18:41:22.861242 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.861246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.861257 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:41:22.861292 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.861295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.861343 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.861412 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:22.861726 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.862456 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.864155 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.865383 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.865548 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.865666 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.866280 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.866375 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":80,"threads_started":1}
I20260808 18:41:22.867024 27147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "29706d568f374e5b943ff589be818c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d" is_pre_election: true
I20260808 18:41:22.867144 27147 raft_consensus.cc:2454] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29706d568f374e5b943ff589be818c96 in term 0.
I20260808 18:41:22.867226 26792 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.867265 26710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "29706d568f374e5b943ff589be818c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f68471179e441a9d1b836e0e65a6c3" is_pre_election: true
I20260808 18:41:22.867509 26710 raft_consensus.cc:2379] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29706d568f374e5b943ff589be818c96 in current term 1: Already voted for candidate d9f68471179e441a9d1b836e0e65a6c3 in this term.
I20260808 18:41:22.867501 26826 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96; no voters:
I20260808 18:41:22.867578 26792 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 election: Requested vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
I20260808 18:41:22.867762 27238 raft_consensus.cc:2781] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:22.867841 27238 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:22.867884 27238 raft_consensus.cc:3037] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:22.867949 27147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d"
I20260808 18:41:22.868052 27147 raft_consensus.cc:3037] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:22.869123 27238 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.869215 27147 raft_consensus.cc:2454] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9f68471179e441a9d1b836e0e65a6c3 in term 1.
I20260808 18:41:22.869460 27238 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [CANDIDATE]: Term 1 election: Requested vote from peers 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819), d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247)
I20260808 18:41:22.869498 26595 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026b42b82108463987068ddcbf8b829d, d9f68471179e441a9d1b836e0e65a6c3; no voters:
I20260808 18:41:22.867867 26920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "d9f68471179e441a9d1b836e0e65a6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29706d568f374e5b943ff589be818c96"
I20260808 18:41:22.869634 26920 raft_consensus.cc:2379] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d9f68471179e441a9d1b836e0e65a6c3 in current term 1: Already voted for candidate 29706d568f374e5b943ff589be818c96 in this term.
I20260808 18:41:22.869644 26792 raft_consensus.cc:2781] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:22.869807 26792 raft_consensus.cc:686] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 LEADER]: Becoming Leader. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Running, Role: LEADER
I20260808 18:41:22.869916 26710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "29706d568f374e5b943ff589be818c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f68471179e441a9d1b836e0e65a6c3"
I20260808 18:41:22.870069 26792 consensus_queue.cc:237] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:22.870641 27147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43fbe3a6416f4f0f98b77e26010a26bd" candidate_uuid: "29706d568f374e5b943ff589be818c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026b42b82108463987068ddcbf8b829d"
I20260808 18:41:22.870821 27147 raft_consensus.cc:2379] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29706d568f374e5b943ff589be818c96 in current term 1: Already voted for candidate d9f68471179e441a9d1b836e0e65a6c3 in this term.
I20260808 18:41:22.871232 26826 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29706d568f374e5b943ff589be818c96; no voters: 026b42b82108463987068ddcbf8b829d, d9f68471179e441a9d1b836e0e65a6c3
I20260808 18:41:22.871388 27238 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 18:41:22.873090 26464 catalog_manager.cc:5495] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "d9f68471179e441a9d1b836e0e65a6c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } health_report { overall_health: HEALTHY } } }
W20260808 18:41:22.885695 27215 tablet.cc:2369] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:22.920826 27246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.917505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40972 (local address 127.4.61.193:35247)
0808 18:41:22.917641 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:22.917645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:22.917679 (+ 34us) server_negotiation.cc:407] Connection header received
0808 18:41:22.917768 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:22.917770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:22.917836 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:22.917924 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:41:22.918144 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.918699 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.919505 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:22.919733 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:22.919817 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:22.920055 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:41:22.920534 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:41:22.920627 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:22.920661 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 18:41:22.920711 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 18:41:22.922091 27006 tablet.cc:2369] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:41:22.924968 26920 raft_consensus.cc:1261] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Refusing update from remote peer d9f68471179e441a9d1b836e0e65a6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:22.924968 27147 raft_consensus.cc:1261] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Refusing update from remote peer d9f68471179e441a9d1b836e0e65a6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:22.925558 27247 consensus_queue.cc:1035] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:22.925727 26792 consensus_queue.cc:1035] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:22.940330 26463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:22.940500 26463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:22.942845 26463 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Sending DeleteTablet for 3 replicas of tablet 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:22.943476 26889 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fbe3a6416f4f0f98b77e26010a26bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:22 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43254
I20260808 18:41:22.943579 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 26536
I20260808 18:41:22.943553 27112 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fbe3a6416f4f0f98b77e26010a26bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:22 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:51966
I20260808 18:41:22.950397 27268 tablet_replica.cc:330] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: stopping tablet replica
I20260808 18:41:22.950825 27268 raft_consensus.cc:2229] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:22.951303 27268 raft_consensus.cc:2258] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:22.951911 27272 tablet_replica.cc:330] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: stopping tablet replica
I20260808 18:41:22.952301 27272 raft_consensus.cc:2229] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:22.952670 27272 raft_consensus.cc:2258] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:22.953032 27268 ts_tablet_manager.cc:1905] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:22.954277 27272 ts_tablet_manager.cc:1905] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:22.955307 27268 ts_tablet_manager.cc:1918] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:22.955413 27268 log.cc:1196] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:22.955685 27268 ts_tablet_manager.cc:1939] T 43fbe3a6416f4f0f98b77e26010a26bd P 29706d568f374e5b943ff589be818c96: Deleting consensus metadata
I20260808 18:41:22.956892 26439 catalog_manager.cc:4841] TS 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): tablet 43fbe3a6416f4f0f98b77e26010a26bd (table test-table [id=c264c1f7a53a4ad18832858cb9fb045e]) successfully deleted
I20260808 18:41:22.957341 27272 ts_tablet_manager.cc:1918] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:22.957465 27272 log.cc:1196] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:22.957839 27272 ts_tablet_manager.cc:1939] T 43fbe3a6416f4f0f98b77e26010a26bd P 026b42b82108463987068ddcbf8b829d: Deleting consensus metadata
I20260808 18:41:22.958974 26442 catalog_manager.cc:4841] TS 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): tablet 43fbe3a6416f4f0f98b77e26010a26bd (table test-table [id=c264c1f7a53a4ad18832858cb9fb045e]) successfully deleted
I20260808 18:41:22.960518 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 26791
W20260808 18:41:22.960568 26442 connection.cc:535] client connection to 127.4.61.193:35247 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 18:41:22.960707 26442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 18:41:22.961704 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:22.961448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:35247 (local address 127.0.0.1:40976)
0808 18:41:22.961570 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:22.961632 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:41:22.961848 26442 catalog_manager.cc:4584] TS d9f68471179e441a9d1b836e0e65a6c3 (127.4.61.193:35247): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43fbe3a6416f4f0f98b77e26010a26bd: Network error: Client connection negotiation failed: client connection to 127.4.61.193:35247: connect: Connection refused (error 111)
I20260808 18:41:22.979580 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 27008
I20260808 18:41:22.989554 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 26412
I20260808 18:41:23.000099 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--webserver_interface=127.4.61.254
--webserver_port=44585
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:23.109551 27274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:23.109830 27274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:23.109870 27274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:23.113893 27274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:23.113965 27274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:23.113984 27274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:23.114014 27274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:23.114042 27274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:23.119537 27274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=44585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:23.120647 27274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:23.121747 27274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:41:23.130200 27274 server_base.cc:1034] running on GCE node
W20260808 18:41:23.130115 27282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.130126 27286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.130115 27283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:23.131026 27274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:23.132151 27274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:23.133334 27274 hybrid_clock.cc:648] HybridClock initialized: now 1786214483133313 us; error 36 us; skew 500 ppm
Aug 08 18:41:23 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:23.136164 27274 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:23.137113 27274 webserver.cc:460] Webserver started at http://127.4.61.254:44585/ using document root <none> and password file <none>
I20260808 18:41:23.137727 27274 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:23.137820 27274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:23.141997 27274 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:23.144155 27294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.145411 27274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:23.145514 27274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "89f2e6b87bbd44069d6012cb2269c066"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "6a72fe0697d28ebee9bcdcbc7fccfeb8"
server_key_iv: "aca499f8fe77be5cfcf4d52a7cf7246d"
server_key_version: "encryptionkey@0"
I20260808 18:41:23.146070 27274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:23.160149 27274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:23.163192 27274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:23.163354 27274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:23.170405 27274 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:36383
I20260808 18:41:23.170670 27383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:36383 every 8 connection(s)
I20260808 18:41:23.171512 27274 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:23.175897 27385 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:41:23.176348 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 27274
I20260808 18:41:23.176810 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:35247
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=41979
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:23.178064 27385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap starting.
I20260808 18:41:23.195991 27385 log.cc:824] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:23.207432 27385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:41:23.207795 27385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066: Bootstrap complete.
I20260808 18:41:23.211777 27385 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:23.212208 27385 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Initialized, Role: FOLLOWER
I20260808 18:41:23.212684 27385 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:23.212803 27385 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:23.212872 27385 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:23.212970 27385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 2 FOLLOWER]: Advancing to term 3
I20260808 18:41:23.214872 27385 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:23.215198 27385 leader_election.cc:302] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89f2e6b87bbd44069d6012cb2269c066; no voters:
I20260808 18:41:23.215494 27385 leader_election.cc:288] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 18:41:23.215598 27393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 18:41:23.215801 27393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [term 3 LEADER]: Becoming Leader. State: Replica: 89f2e6b87bbd44069d6012cb2269c066, State: Running, Role: LEADER
I20260808 18:41:23.216102 27393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } }
I20260808 18:41:23.216758 27385 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:23.217077 27393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89f2e6b87bbd44069d6012cb2269c066. Latest consensus state: current_term: 3 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:23.217198 27393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:23.217576 27398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:23.217607 27394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "89f2e6b87bbd44069d6012cb2269c066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89f2e6b87bbd44069d6012cb2269c066" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36383 } } }
I20260808 18:41:23.217830 27394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89f2e6b87bbd44069d6012cb2269c066 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:23.222919 27398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:23.223729 27398 catalog_manager.cc:1259] Loaded cluster ID: ea30c33e33384a41ae63769a87bdb4ee
I20260808 18:41:23.223793 27398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 18:41:23.224962 27398 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa7e87719ad google::LogMessage::Fail() at ??:0
@ 0x7fa7e877488a google::LogMessage::SendToLog() at ??:0
@ 0x7fa7e87714de google::LogMessage::Flush() at ??:0
@ 0x7fa7e8772a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa7f30b0fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fa7f30b1d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa7f30ae579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fa7f30f2640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa7ea9c33d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa7ea9c3c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fa7ea9c53f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa7ea9b4512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa7ebff86db start_thread at ??:0
@ 0x7fa7e726f61f clone at ??:0
W20260808 18:41:23.303478 27390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:23.303766 27390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:23.303843 27390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:23.307842 27390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:23.307898 27390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:23.307976 27390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:23.314208 27390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:35247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=41979
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:23.315680 27390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:23.317196 27390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:23.327133 27450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.327135 27449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:23.327385 27390 server_base.cc:1034] running on GCE node
W20260808 18:41:23.327602 27455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:23.328006 27390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:23.328652 27390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:23.329823 27390 hybrid_clock.cc:648] HybridClock initialized: now 1786214483329808 us; error 29 us; skew 500 ppm
Aug 08 18:41:23 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:23.332417 27390 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:23.333257 27390 webserver.cc:460] Webserver started at http://127.4.61.193:41979/ using document root <none> and password file <none>
I20260808 18:41:23.333786 27390 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:23.333846 27390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:23.337610 27390 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:23.339749 27467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.341117 27390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:23.341221 27390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "d9f68471179e441a9d1b836e0e65a6c3"
format_stamp: "Formatted at 2026-08-08 18:41:20 on dist-test-slave-fgb3"
server_key: "67edbb20608e56726015584c43cc6059"
server_key_iv: "386be84c822ea8114c6883d50290af3e"
server_key_version: "encryptionkey@0"
I20260808 18:41:23.341838 27390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:23.365346 27390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:23.368489 27390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:23.368659 27390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:23.369266 27390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:23.370383 27480 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 18:41:23.374393 27390 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 18:41:23.374449 27390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 18:41:23.374498 27390 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 18:41:23.376127 27390 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 18:41:23.376184 27390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 18:41:23.376472 27480 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap starting.
I20260808 18:41:23.386878 27390 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:35247
I20260808 18:41:23.387267 27656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:35247 every 8 connection(s)
I20260808 18:41:23.388204 27390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:23.396468 27480 log.cc:824] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:23.396929 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 27390
I20260808 18:41:23.397447 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:40495
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=43957
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:23.404436 27480 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:41:23.404829 27480 tablet_bootstrap.cc:492] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Bootstrap complete.
I20260808 18:41:23.406148 27480 ts_tablet_manager.cc:1397] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Time spent bootstrapping tablet: real 0.030s user 0.019s sys 0.007s
I20260808 18:41:23.409413 27480 raft_consensus.cc:348] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:23.409976 27480 raft_consensus.cc:729] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f68471179e441a9d1b836e0e65a6c3, State: Initialized, Role: FOLLOWER
I20260808 18:41:23.410540 27480 consensus_queue.cc:260] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:23.411648 27480 ts_tablet_manager.cc:1428] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
W20260808 18:41:23.484486 27659 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:41:23.390635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:58781)
0808 18:41:23.391269 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.391331 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:23.392419 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:23.483671 (+ 91252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":168,"threads_started":1}
W20260808 18:41:23.485131 27657 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:36383 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:36383: Client connection negotiation failed: client connection to 127.4.61.254:36383: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 18:41:23.485899 27659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.485648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:45865)
0808 18:41:23.485774 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.485844 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 18:41:23.486614 27659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.486427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:46653)
0808 18:41:23.486520 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.486563 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 18:41:23.486807 27657 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:41:23.517306 27661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:23.517577 27661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:23.517621 27661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:23.521634 27661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:23.521690 27661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:23.521746 27661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:23.526849 27661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:40495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=43957
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:23.527770 27661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:23.528724 27661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:23.538054 27667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.538061 27670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.538332 27668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:23.538475 27661 server_base.cc:1034] running on GCE node
I20260808 18:41:23.538872 27661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:23.539507 27661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:23.540659 27661 hybrid_clock.cc:648] HybridClock initialized: now 1786214483540636 us; error 34 us; skew 500 ppm
Aug 08 18:41:23 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:23.543305 27661 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:23.544183 27661 webserver.cc:460] Webserver started at http://127.4.61.194:43957/ using document root <none> and password file <none>
I20260808 18:41:23.544821 27661 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:23.544904 27661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:23.548688 27661 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 18:41:23.550693 27682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.551833 27661 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:41:23.551949 27661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "29706d568f374e5b943ff589be818c96"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "cae2195a1d1a33ccfd6121dedcc0ea18"
server_key_iv: "04ce0b378c3f9e68e18e89f2a17328b4"
server_key_version: "encryptionkey@0"
I20260808 18:41:23.552474 27661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:23.564337 27661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:23.567217 27661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:23.567394 27661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:23.567977 27661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:23.568785 27661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:23.568833 27661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.568895 27661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:23.568922 27661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.578088 27661 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:40495
I20260808 18:41:23.578122 27860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:40495 every 8 connection(s)
I20260808 18:41:23.579097 27661 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:41:23.579962 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 27661
I20260808 18:41:23.580318 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:45819
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:36383
--webserver_port=38927
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:41:23.585060 27865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.583492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:47957)
0808 18:41:23.584203 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.584308 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":140,"threads_started":1}
W20260808 18:41:23.585516 27861 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:36383 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:36383: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
I20260808 18:41:23.586082 27865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.585881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:41471)
0808 18:41:23.585986 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.586030 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 18:41:23.586752 27865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.586559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:40757)
0808 18:41:23.586657 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.586702 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 18:41:23.586901 27861 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:41:23.692426 27864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:23.692670 27864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:23.692737 27864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:23.696585 27864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:23.696636 27864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:23.696712 27864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:23.701663 27864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:45819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=38927
--tserver_master_addrs=127.4.61.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:23.702673 27864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:23.703639 27864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:23.712589 27874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.712584 27870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:23.712680 27872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:23.712898 27864 server_base.cc:1034] running on GCE node
I20260808 18:41:23.713267 27864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:23.713871 27864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:23.715023 27864 hybrid_clock.cc:648] HybridClock initialized: now 1786214483715003 us; error 31 us; skew 500 ppm
Aug 08 18:41:23 dist-test-slave-fgb3 krb5kdc[25559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:23.717739 27864 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:23.718725 27864 webserver.cc:460] Webserver started at http://127.4.61.195:38927/ using document root <none> and password file <none>
I20260808 18:41:23.719267 27864 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:23.719338 27864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:23.723148 27864 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:23.725162 27883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.726379 27864 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:41:23.726490 27864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "026b42b82108463987068ddcbf8b829d"
format_stamp: "Formatted at 2026-08-08 18:41:21 on dist-test-slave-fgb3"
server_key: "778b1af6891f665ce2904c421ddf78b5"
server_key_iv: "f28ba0d6c5f8649d7beb5b802b2b4454"
server_key_version: "encryptionkey@0"
I20260808 18:41:23.727048 27864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:23.752287 27864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:23.755463 27864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:23.755640 27864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:23.756235 27864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:23.757081 27864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:23.757129 27864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.757181 27864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:23.757211 27864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:23.765654 27864 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:45819
I20260808 18:41:23.765695 28051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:45819 every 8 connection(s)
I20260808 18:41:23.766673 27864 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:23.767913 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 27864
I20260808 18:41:23.770435 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.768910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:43271)
0808 18:41:23.769599 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.769700 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":117,"threads_started":1}
W20260808 18:41:23.770876 28052 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:36383 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:36383: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
I20260808 18:41:23.771370 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.771173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:53921)
0808 18:41:23.771274 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.771318 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 18:41:23.771852 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:23.771687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:33737)
0808 18:41:23.771770 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:23.771806 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 18:41:23.771981 28052 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 18:41:24.487962 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.487510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:52647)
0808 18:41:24.487773 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:24.487827 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260808 18:41:24.558133 28059 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:24.558352 28059 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:24.559484 28059 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
Aug 08 18:41:24 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.194@KRBTEST.COM
Aug 08 18:41:24 dist-test-slave-fgb3 krb5kdc[25559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214483, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.195@KRBTEST.COM
I20260808 18:41:24.572819 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.559702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:40495 (local address 127.4.61.193:56971)
0808 18:41:24.559902 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:24.559917 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:24.560040 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:24.561814 (+ 1774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:24.561820 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:24.562294 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:24.562850 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:24.562865 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.564311 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.564314 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:24.565247 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:24.565257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.566014 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.566019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:24.566219 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:24.566865 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:24.566877 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:24.568263 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:24.570228 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:24.570234 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:24.570247 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:24.570606 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:24.570969 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:24.570971 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:24.570973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:24.571149 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:24.571889 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:24.571896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:24.572144 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 18:41:24.572297 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 18:41:24.572630 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":144,"spinlock_wait_cycles":23424}
I20260808 18:41:24.572860 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.559965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:43565 (local address 127.4.61.195:45819)
0808 18:41:24.560345 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:24.560360 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:24.560399 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:41:24.561085 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:24.561092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:24.561453 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:24.561732 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:24.562979 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.564159 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.565410 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.565851 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.566001 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:24.568798 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:24.568802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:24.568813 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:24.568846 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:24.570607 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:24.571053 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:24.571059 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:24.571064 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:24.571189 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:24.571512 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:24.571514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:24.571515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:24.571889 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:24.572029 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:24.572447 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 18:41:24.572707 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":66,"threads_started":1}
I20260808 18:41:24.572897 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.559877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:56971 (local address 127.4.61.194:40495)
0808 18:41:24.560296 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:24.560311 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:24.560350 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:41:24.561085 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:24.561092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:24.561452 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:24.561693 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:24.563035 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.564170 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.565361 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.565857 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.566190 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:24.568492 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:24.568499 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:24.568514 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:24.568549 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:24.570108 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:24.570717 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:24.570724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:24.570729 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:24.570868 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:24.571336 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:24.571340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:24.571341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:24.571772 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:24.571876 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:24.572455 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 18:41:24.572702 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":119,"threads_started":1}
I20260808 18:41:24.572911 28060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.559788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:45819 (local address 127.4.61.193:43565)
0808 18:41:24.560146 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:24.560174 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:24.560290 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:24.562076 (+ 1786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:24.562078 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:24.562340 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:24.562776 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:24.562791 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.564305 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.564308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:24.565284 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:24.565295 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:24.565968 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:24.565971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:24.566223 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:24.566810 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:24.566826 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:24.568628 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:24.570706 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:24.570709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:24.570711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:24.570951 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:24.571308 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:24.571312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:24.571314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:24.571421 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:24.572008 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:24.572010 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:24.572145 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 18:41:24.572300 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 18:41:24.572704 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":259,"spinlock_wait_cycles":36224,"thread_start_us":76,"threads_started":1}
W20260808 18:41:24.576202 27472 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
W20260808 18:41:24.576375 27470 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:24.576476 27470 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9f68471179e441a9d1b836e0e65a6c3; no voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96
I20260808 18:41:24.576730 28059 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:41:24.587705 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.587348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:42165)
0808 18:41:24.587563 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:24.587612 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":65,"threads_started":1}
I20260808 18:41:24.772840 28071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:24.772456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:35099)
0808 18:41:24.772672 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:24.772723 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":68,"threads_started":1}
I20260808 18:41:25.489317 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:25.488864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:53313)
0808 18:41:25.489146 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:25.489213 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":91,"threads_started":1}
I20260808 18:41:25.589100 28076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:25.588597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:39785)
0808 18:41:25.588906 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:25.588974 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":82,"threads_started":1}
I20260808 18:41:25.774163 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:25.773696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:43215)
0808 18:41:25.773988 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:25.774052 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":79,"threads_started":1}
I20260808 18:41:26.376246 28078 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:26.376398 28078 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:26.376878 28078 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
W20260808 18:41:26.377818 27472 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
W20260808 18:41:26.377974 27470 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:26.378062 27470 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9f68471179e441a9d1b836e0e65a6c3; no voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96
I20260808 18:41:26.378206 28078 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:41:26.490581 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:26.490080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:54653)
0808 18:41:26.490416 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:26.490475 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260808 18:41:26.590303 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:26.589897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:48245)
0808 18:41:26.590142 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:26.590201 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20260808 18:41:26.775264 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:26.774867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:52201)
0808 18:41:26.775105 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:26.775161 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
I20260808 18:41:27.491840 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:27.491379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:41755)
0808 18:41:27.491672 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:27.491736 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":86,"threads_started":1}
I20260808 18:41:27.591698 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:27.591248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:59445)
0808 18:41:27.591529 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:27.591595 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":98,"threads_started":1}
I20260808 18:41:27.776520 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:27.776048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:49391)
0808 18:41:27.776353 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:27.776418 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":79,"threads_started":1}
I20260808 18:41:28.493237 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:28.492758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:36033)
0808 18:41:28.493070 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:28.493131 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":75,"threads_started":1}
I20260808 18:41:28.592926 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:28.592472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:47905)
0808 18:41:28.592751 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:28.592823 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":83,"threads_started":1}
I20260808 18:41:28.777908 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:28.777393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:53783)
0808 18:41:28.777743 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:28.777806 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":129,"threads_started":1}
I20260808 18:41:29.494022 28091 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:29.494184 28091 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:29.494580 28092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:29.494046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:60475)
0808 18:41:29.494417 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:29.494484 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":123,"threads_started":1}
I20260808 18:41:29.494638 28091 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
W20260808 18:41:29.495455 27470 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
W20260808 18:41:29.495643 27472 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:29.495707 27472 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9f68471179e441a9d1b836e0e65a6c3; no voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96
I20260808 18:41:29.495836 28091 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:41:29.594357 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:29.593795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:57053)
0808 18:41:29.594132 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:29.594199 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":124,"threads_started":1}
I20260808 18:41:29.779223 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:29.778764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:51663)
0808 18:41:29.779044 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:29.779113 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":104,"threads_started":1}
I20260808 18:41:30.495826 28096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:30.495389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:40899)
0808 18:41:30.495643 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:30.495702 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":74,"threads_started":1}
I20260808 18:41:30.595794 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:30.595220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:45363)
0808 18:41:30.595572 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:30.595652 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":91,"threads_started":1}
I20260808 18:41:30.780570 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:30.780051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:43375)
0808 18:41:30.780403 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:30.780468 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":77,"threads_started":1}
I20260808 18:41:31.256186 28102 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:31.256340 28102 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:31.256816 28102 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
W20260808 18:41:31.257542 27470 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
W20260808 18:41:31.257654 27472 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:31.257751 27472 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9f68471179e441a9d1b836e0e65a6c3; no voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96
I20260808 18:41:31.257893 28102 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:41:31.497089 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:31.496616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:60399)
0808 18:41:31.496924 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:31.496986 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":107,"threads_started":1}
I20260808 18:41:31.597009 28105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:31.596558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:50087)
0808 18:41:31.596850 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:31.596908 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":95,"threads_started":1}
I20260808 18:41:31.781847 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:31.781322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:37849)
0808 18:41:31.781645 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:31.781718 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":86,"threads_started":1}
I20260808 18:41:32.498406 28107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:32.497907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:58411)
0808 18:41:32.498198 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:32.498260 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
I20260808 18:41:32.599830 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:32.598357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:44133)
0808 18:41:32.599620 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:32.599695 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1169,"thread_start_us":1043,"threads_started":1}
I20260808 18:41:32.783071 28112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:32.782626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:59467)
0808 18:41:32.782905 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:32.782965 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":74,"threads_started":1}
I20260808 18:41:33.499693 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:33.499247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:38239)
0808 18:41:33.499523 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:33.499587 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":78,"threads_started":1}
I20260808 18:41:33.601143 28115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:33.600700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:37201)
0808 18:41:33.600970 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:33.601041 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":75,"threads_started":1}
I20260808 18:41:33.784317 28119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:33.783817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:40467)
0808 18:41:33.784129 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:33.784190 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":106,"threads_started":1}
I20260808 18:41:34.501049 28120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:34.500542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:42581)
0808 18:41:34.500879 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:34.500942 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":117,"threads_started":1}
I20260808 18:41:34.602497 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:34.601980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:54199)
0808 18:41:34.602298 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:34.602392 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":99,"threads_started":1}
I20260808 18:41:34.785547 28122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:34.785110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:44803)
0808 18:41:34.785384 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:34.785447 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
I20260808 18:41:35.502251 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:35.501808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:58145)
0808 18:41:35.502073 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:35.502131 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":75,"threads_started":1}
I20260808 18:41:35.603718 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:35.603260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:50143)
0808 18:41:35.603564 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:35.603616 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":106,"threads_started":1}
I20260808 18:41:35.786934 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:35.786464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:34413)
0808 18:41:35.786750 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:35.786814 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":77,"threads_started":1}
I20260808 18:41:36.503496 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:36.503059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:39399)
0808 18:41:36.503339 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:36.503396 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":90,"threads_started":1}
I20260808 18:41:36.604861 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:36.604451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:34987)
0808 18:41:36.604694 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:36.604752 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":84,"threads_started":1}
I20260808 18:41:36.788236 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:36.787751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:59849)
0808 18:41:36.788066 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:36.788131 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":86,"threads_started":1}
I20260808 18:41:37.504735 28130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:37.504287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:49303)
0808 18:41:37.504559 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:37.504626 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":87,"threads_started":1}
I20260808 18:41:37.606125 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:37.605679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:45821)
0808 18:41:37.605971 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:37.606025 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":103,"threads_started":1}
I20260808 18:41:37.789471 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:37.789011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:52559)
0808 18:41:37.789314 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:37.789373 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":94,"threads_started":1}
I20260808 18:41:38.342163 28138 raft_consensus.cc:482] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:38.342343 28138 raft_consensus.cc:504] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29706d568f374e5b943ff589be818c96" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 40495 } } peers { permanent_uuid: "026b42b82108463987068ddcbf8b829d" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 45819 } } peers { permanent_uuid: "d9f68471179e441a9d1b836e0e65a6c3" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 35247 } }
I20260808 18:41:38.342760 28138 leader_election.cc:288] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495), 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819)
W20260808 18:41:38.343461 27472 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 026b42b82108463987068ddcbf8b829d (127.4.61.195:45819): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
W20260808 18:41:38.343575 27470 leader_election.cc:341] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 29706d568f374e5b943ff589be818c96 (127.4.61.194:40495): Not found: Tablet not found: 43fbe3a6416f4f0f98b77e26010a26bd
I20260808 18:41:38.343667 27470 leader_election.cc:302] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9f68471179e441a9d1b836e0e65a6c3; no voters: 026b42b82108463987068ddcbf8b829d, 29706d568f374e5b943ff589be818c96
I20260808 18:41:38.343818 28138 raft_consensus.cc:2726] T 43fbe3a6416f4f0f98b77e26010a26bd P d9f68471179e441a9d1b836e0e65a6c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:41:38.506067 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:38.505645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.193:37023)
0808 18:41:38.505910 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:38.505964 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260808 18:41:38.607436 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:38.606973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.194:52217)
0808 18:41:38.607270 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:38.607337 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":76,"threads_started":1}
I20260808 18:41:38.773486 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 27390
I20260808 18:41:38.790889 28142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:38.790471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36383 (local address 127.4.61.195:50869)
0808 18:41:38.790720 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:38.790780 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":67,"threads_started":1}
I20260808 18:41:38.792092 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 27661
I20260808 18:41:38.804219 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 27864
2026-08-08T18:41:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19661 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:41:38 dist-test-slave-fgb3 krb5kdc[28147](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:41:38 dist-test-slave-fgb3 krb5kdc[28147](info): set up 2 sockets
Aug 08 18:41:38 dist-test-slave-fgb3 krb5kdc[28147](info): commencing operation
krb5kdc: starting...
W20260808 18:41:39.954205 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:41:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:41:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:41:40.081063 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:40.191100 28168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:40.191355 28168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:40.191413 28168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:40.195313 28168 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 18:41:40.195363 28168 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 18:41:40.195384 28168 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 18:41:40.195401 28168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:41:40.195433 28168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:40.195466 28168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:40.195498 28168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:41:40.195526 28168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:41:40.201006 28168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:40.202077 28168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:40.203305 28168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:40.211812 28176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.211802 28177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.211802 28181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:40.212214 28168 server_base.cc:1034] running on GCE node
I20260808 18:41:40.212806 28168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:40.213945 28168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:40.215114 28168 hybrid_clock.cc:648] HybridClock initialized: now 1786214500215093 us; error 33 us; skew 500 ppm
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:40.217902 28168 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:41:40.218883 28168 webserver.cc:460] Webserver started at http://127.4.61.254:44911/ using document root <none> and password file <none>
I20260808 18:41:40.219444 28168 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:40.219511 28168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:40.219713 28168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:40.221982 28168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "e01d23cc8ffd4ef694740e6dc109d268"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d39bb1181e26302d7ed20fdf2329d0d5"
server_key_iv: "ddd1ae6f1326f583ebc91e344f6f4967"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.222594 28168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "e01d23cc8ffd4ef694740e6dc109d268"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d39bb1181e26302d7ed20fdf2329d0d5"
server_key_iv: "ddd1ae6f1326f583ebc91e344f6f4967"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.226478 28168 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 18:41:40.229080 28188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.230443 28168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:40.230571 28168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "e01d23cc8ffd4ef694740e6dc109d268"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d39bb1181e26302d7ed20fdf2329d0d5"
server_key_iv: "ddd1ae6f1326f583ebc91e344f6f4967"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.230688 28168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:40.256774 28168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:40.260102 28168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:40.260309 28168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:40.269845 28168 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40853
I20260808 18:41:40.270120 28271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40853 every 8 connection(s)
I20260808 18:41:40.270984 28168 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:41:40.274075 28272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:40.278095 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 28168
I20260808 18:41:40.278224 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:41:40.278594 4343 external_mini_cluster.cc:1428] Setting key f9b19b32340c1a0754f825f50903faff
I20260808 18:41:40.280351 28272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap starting.
I20260808 18:41:40.282641 28272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:40.283538 28272 log.cc:824] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:40.285589 28272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: No bootstrap required, opened a new log
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:40.289872 28272 raft_consensus.cc:348] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:41:40.290120 28272 raft_consensus.cc:374] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:40.290169 28272 raft_consensus.cc:729] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Initialized, Role: FOLLOWER
I20260808 18:41:40.290671 28272 consensus_queue.cc:260] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:41:40.290810 28272 raft_consensus.cc:388] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:41:40.290912 28272 raft_consensus.cc:482] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:41:40.291026 28272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:40.292052 28272 raft_consensus.cc:504] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:41:40.292443 28272 leader_election.cc:302] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e01d23cc8ffd4ef694740e6dc109d268; no voters:
I20260808 18:41:40.292862 28272 leader_election.cc:288] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:41:40.292948 28279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:40.293138 28279 raft_consensus.cc:686] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 LEADER]: Becoming Leader. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Running, Role: LEADER
I20260808 18:41:40.293504 28279 consensus_queue.cc:237] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:41:40.293874 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.280160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53818 (local address 127.4.61.254:40853)
0808 18:41:40.280643 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:40.280659 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:40.280696 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:41:40.281362 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:40.281379 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:40.281706 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:40.282031 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:40.282907 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.284262 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.285172 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.285866 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.286031 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:40.288826 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:40.288832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:40.288847 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:40.288878 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:40.290737 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.291243 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.291249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.291254 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.291380 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.291665 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.291667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.291668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.292077 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:40.292272 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:40.292538 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 18:41:40.292878 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":146,"threads_started":1}
I20260808 18:41:40.294215 28272 sys_catalog.cc:564] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:41:40.296485 28282 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e01d23cc8ffd4ef694740e6dc109d268. Latest consensus state: current_term: 1 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:41:40.296620 28282 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:40.296753 28281 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:41:40.296859 28281 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:41:40.297034 28303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:41:40.300072 28303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:41:40.306682 28303 catalog_manager.cc:1347] Generated new cluster ID: fcaef2db427747be84af4974a9d46c5f
I20260808 18:41:40.306779 28303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:41:40.314204 28303 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:41:40.315706 28303 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:41:40.330413 28303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Generated new TSK 0
I20260808 18:41:40.331365 28303 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:41:40.366019 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:40.483246 28312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:40.483523 28312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:40.483568 28312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:40.487707 28312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:40.487783 28312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:40.487843 28312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:41:40.493247 28312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:40.494431 28312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:40.495565 28312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:40.505399 28323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.505399 28322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:40.505753 28312 server_base.cc:1034] running on GCE node
W20260808 18:41:40.505415 28326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:40.506181 28312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:40.506847 28312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:40.508031 28312 hybrid_clock.cc:648] HybridClock initialized: now 1786214500508008 us; error 31 us; skew 500 ppm
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:40.510902 28312 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:41:40.511782 28312 webserver.cc:460] Webserver started at http://127.4.61.193:40079/ using document root <none> and password file <none>
I20260808 18:41:40.512327 28312 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:40.512387 28312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:40.512588 28312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:40.514904 28312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "87429d1983bab9933a774d0c69b8bc80"
server_key_iv: "14a993bd891c058d3aac35c4c44fd110"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.515612 28312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "87429d1983bab9933a774d0c69b8bc80"
server_key_iv: "14a993bd891c058d3aac35c4c44fd110"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.519810 28312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:41:40.522276 28336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.523578 28312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:41:40.523696 28312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "87429d1983bab9933a774d0c69b8bc80"
server_key_iv: "14a993bd891c058d3aac35c4c44fd110"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.523804 28312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:40.538276 28312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:40.541687 28312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:40.541883 28312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:40.542578 28312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:40.543462 28312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:40.543512 28312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.543569 28312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:40.543593 28312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.552631 28312 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:36407
I20260808 18:41:40.552668 28526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:36407 every 8 connection(s)
I20260808 18:41:40.553577 28312 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:41:40.553856 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 28312
I20260808 18:41:40.553982 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:41:40.554369 4343 external_mini_cluster.cc:1428] Setting key ad68b733a99093b9105d6726439296aa
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:41:40.569361 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.555502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:40119 (local address 127.4.61.254:40853)
0808 18:41:40.555650 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:40.555655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:40.556733 (+ 1078us) server_negotiation.cc:407] Connection header received
0808 18:41:40.558196 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:40.558199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:40.558248 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:40.558308 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:40.559974 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.560719 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.562515 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.562751 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.562835 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:40.565734 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:40.565737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:40.565739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:40.565765 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:40.567169 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.567666 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.567668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.567669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.567753 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.568116 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.568118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.568119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.568340 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:40.568437 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:40.569029 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 18:41:40.569179 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:41:40.570169 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.555973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:40119)
0808 18:41:40.556511 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:40.556558 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:40.557918 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:40.558560 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:40.558569 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:40.559096 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:40.559782 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:40.559802 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.560896 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.560899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:40.562382 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:40.562394 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.562924 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.562928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:40.563144 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:40.563748 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:40.563771 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:40.565535 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:40.567287 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:40.567293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:40.567308 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:40.567584 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:40.567875 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:40.567878 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:40.567880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:40.568035 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:40.568458 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:40.568463 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:40.568764 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 18:41:40.568939 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 18:41:40.569240 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":154,"threads_started":1}
I20260808 18:41:40.571504 28527 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
I20260808 18:41:40.571798 28527 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:40.572391 28527 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:41:40.573968 28219 ts_manager.cc:194] Registered new tserver with Master: 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:41:40.575266 28219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:40119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:41:40.586499 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:40.702405 28536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:40.702682 28536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:40.702724 28536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:40.706831 28536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:40.706909 28536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:40.706971 28536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:41:40.712438 28536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:40.713583 28536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:40.714680 28536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:40.724650 28551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.724650 28544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.724668 28546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:40.724702 28536 server_base.cc:1034] running on GCE node
I20260808 18:41:40.725374 28536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:40.726081 28536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:40.727246 28536 hybrid_clock.cc:648] HybridClock initialized: now 1786214500727213 us; error 46 us; skew 500 ppm
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:40.730082 28536 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:41:40.731052 28536 webserver.cc:460] Webserver started at http://127.4.61.194:42415/ using document root <none> and password file <none>
I20260808 18:41:40.731623 28536 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:40.731693 28536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:40.731910 28536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:40.734000 28536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "bb68afc366a340de813322670f483816"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d1f8aae0ad5bdb6cf0647a6a236eadbc"
server_key_iv: "eaba03d21d032abdf28517297a34f4fd"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.734591 28536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "bb68afc366a340de813322670f483816"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d1f8aae0ad5bdb6cf0647a6a236eadbc"
server_key_iv: "eaba03d21d032abdf28517297a34f4fd"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.738531 28536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 18:41:40.741217 28562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.742664 28536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:41:40.742780 28536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "bb68afc366a340de813322670f483816"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d1f8aae0ad5bdb6cf0647a6a236eadbc"
server_key_iv: "eaba03d21d032abdf28517297a34f4fd"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.742889 28536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:40.763599 28536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:40.766990 28536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:40.767190 28536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:40.767841 28536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:40.768759 28536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:40.768823 28536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.768882 28536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:40.768908 28536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.777577 28536 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:39243
I20260808 18:41:40.777626 28739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:39243 every 8 connection(s)
I20260808 18:41:40.778609 28536 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:41:40.784679 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 28536
I20260808 18:41:40.784791 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:41:40.785140 4343 external_mini_cluster.cc:1428] Setting key fbd280ca8771f146da4e504009448796
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:40.793735 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.780527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:45145 (local address 127.4.61.254:40853)
0808 18:41:40.780687 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:40.780692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:40.781591 (+ 899us) server_negotiation.cc:407] Connection header received
0808 18:41:40.782902 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:40.782905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:40.782956 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:40.783030 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:40.784255 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.784828 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.786253 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.786535 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.786636 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:40.789680 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:40.789683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:40.789685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:40.789710 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:40.791243 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.791753 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.791757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.791758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.791865 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:40.792389 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:40.792392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:40.792393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:40.792609 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:40.792721 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:40.793375 (+ 654us) server_negotiation.cc:299] Negotiation successful
0808 18:41:40.793520 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:41:40.794669 28743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.780976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:45145)
0808 18:41:40.781438 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:40.781484 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:40.782699 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:40.783191 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:40.783197 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:40.783597 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:40.784088 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:40.784101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.784964 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.784968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:40.786125 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:40.786137 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:40.786876 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:40.786881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:40.787083 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:40.787701 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:40.787723 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:40.789498 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:40.791376 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:40.791381 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:40.791394 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:40.791652 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:40.792012 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:40.792015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:40.792017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:40.792256 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:40.792726 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:40.792733 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:40.793079 (+ 346us) client_negotiation.cc:769] Sending connection context
0808 18:41:40.793309 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 18:41:40.793683 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":112,"threads_started":1}
I20260808 18:41:40.795993 28740 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
I20260808 18:41:40.796293 28740 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:40.796958 28740 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:41:40.798382 28219 ts_manager.cc:194] Registered new tserver with Master: bb68afc366a340de813322670f483816 (127.4.61.194:39243)
I20260808 18:41:40.799052 28219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:45145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:41:40.814253 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:41:40.927309 28749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:41:40.927547 28749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:41:40.927587 28749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:41:40.931533 28749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:41:40.931586 28749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:41:40.931641 28749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:41:40.936808 28749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:41:40.937831 28749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:41:40.938869 28749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:41:40.948359 28761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.948383 28759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:41:40.948367 28763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:41:40.948570 28749 server_base.cc:1034] running on GCE node
I20260808 18:41:40.949007 28749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:41:40.949645 28749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:41:40.950809 28749 hybrid_clock.cc:648] HybridClock initialized: now 1786214500950785 us; error 33 us; skew 500 ppm
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:41:40.953487 28749 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:41:40.954360 28749 webserver.cc:460] Webserver started at http://127.4.61.195:42259/ using document root <none> and password file <none>
I20260808 18:41:40.954900 28749 fs_manager.cc:359] Metadata directory not provided
I20260808 18:41:40.954960 28749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:41:40.955156 28749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:41:40.957132 28749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "370cc314d01c496699d471286850936e"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "096b32495b6e90b9ba22ee5ce9953f30"
server_key_iv: "398e0452b025daba79cb83868eb75704"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.957671 28749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "370cc314d01c496699d471286850936e"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "096b32495b6e90b9ba22ee5ce9953f30"
server_key_iv: "398e0452b025daba79cb83868eb75704"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.961618 28749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:41:40.963999 28774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.965157 28749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:41:40.965272 28749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "370cc314d01c496699d471286850936e"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "096b32495b6e90b9ba22ee5ce9953f30"
server_key_iv: "398e0452b025daba79cb83868eb75704"
server_key_version: "encryptionkey@0"
I20260808 18:41:40.965373 28749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:41:40.982065 28749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:41:40.985158 28749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:41:40.985332 28749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:41:40.985914 28749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:41:40.986747 28749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:41:40.986794 28749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.986838 28749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:41:40.986868 28749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:41:40.995244 28749 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:33071
I20260808 18:41:40.995277 28944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:33071 every 8 connection(s)
I20260808 18:41:40.996143 28749 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:41:41.001096 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 28749
I20260808 18:41:41.001237 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:41:41.001567 4343 external_mini_cluster.cc:1428] Setting key 234118637144ba939008c476c3bf151a
Aug 08 18:41:40 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214500, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:41:41.010387 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.997935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:43333 (local address 127.4.61.254:40853)
0808 18:41:40.998120 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:40.998123 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:40.998967 (+ 844us) server_negotiation.cc:407] Connection header received
0808 18:41:41.000298 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.000302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.000359 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.000434 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:41.001981 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.002653 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.004121 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.004349 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.004430 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.006842 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:41.006845 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:41.006848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:41.006872 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:41.008256 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:41.008774 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:41.008778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:41.008779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:41.008864 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:41.009259 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:41.009262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:41.009264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:41.009465 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:41.009547 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.010060 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.010168 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 18:41:41.011189 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:40.998337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:43333)
0808 18:41:40.998807 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:40.998850 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.000049 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.000621 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.000628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.001114 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:41:41.001795 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.001817 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.002809 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.002812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.004017 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.004028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.004478 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.004482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.004635 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.005190 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:41:41.005206 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:41:41.006671 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:41:41.008374 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:41.008379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:41.008392 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:41.008658 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:41.008943 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:41:41.008944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:41:41.008946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:41:41.009106 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:41:41.009568 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:41:41.009574 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:41:41.009831 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.009995 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.010278 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":113,"threads_started":1}
I20260808 18:41:41.012446 28945 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
I20260808 18:41:41.012683 28945 heartbeater.cc:464] Registering TS with master...
I20260808 18:41:41.013172 28945 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:41:41.014250 28219 ts_manager.cc:194] Registered new tserver with Master: 370cc314d01c496699d471286850936e (127.4.61.195:33071)
I20260808 18:41:41.014947 28219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:43333
I20260808 18:41:41.015587 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:41:41.024531 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.017568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53832 (local address 127.4.61.254:40853)
0808 18:41:41.017691 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.017695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.017877 (+ 182us) server_negotiation.cc:407] Connection header received
0808 18:41:41.018010 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.018013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.018057 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.018122 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:41:41.018905 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.019419 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.020281 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.020490 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.020579 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.021866 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:41:41.021869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:41:41.021871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:41:41.021895 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:41:41.023198 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:41.023544 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:41.023547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:41.023548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:41.023614 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:41:41.023800 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:41:41.023802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:41:41.023804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:41:41.023999 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:41:41.024095 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.024259 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.024368 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:41:41.027526 28217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:41:41.030575 28217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:41:41.045826 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.040542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55754 (local address 127.4.61.193:36407)
0808 18:41:41.041048 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.041062 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.041080 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:41:41.041144 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.041148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.041295 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.041436 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:41.041858 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.042890 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.044141 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.045002 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.045115 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.045287 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.045558 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.045661 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":93,"threads_started":1}
I20260808 18:41:41.045821 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.040190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.0.0.1:55754)
0808 18:41:41.040674 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.040686 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.040760 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.041611 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.041614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.041633 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:41.041728 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.041734 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.043056 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.043059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.044020 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.044030 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.045125 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.045128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.045328 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.045394 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.045510 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.045649 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":55,"thread_start_us":95,"threads_started":1}
I20260808 18:41:41.045821 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.039712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:33071 (local address 127.0.0.1:45208)
0808 18:41:41.040255 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.040266 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.040346 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.041410 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.041413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.041430 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:41.041513 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.041519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.042573 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.042576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.044173 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.044185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.045192 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.045195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.045298 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.045394 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.045510 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.045640 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":135,"thread_start_us":91,"threads_started":1}
I20260808 18:41:41.046482 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.040267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45208 (local address 127.4.61.195:33071)
0808 18:41:41.040967 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.040979 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.041002 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:41:41.041079 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.041084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.041284 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.041436 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:41.041605 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.042455 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.044309 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.045096 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.045185 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.045293 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.046063 (+ 770us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.046331 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":161,"threads_started":1}
I20260808 18:41:41.047851 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.039424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.0.0.1:58692)
0808 18:41:41.039834 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.039891 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.040012 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.041078 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.041084 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.041105 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:41.041250 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.041256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.042629 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.042632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.044173 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.044185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.047470 (+ 3285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.047474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.047562 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.047586 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.047656 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.047725 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":105,"thread_start_us":108,"threads_started":1}
I20260808 18:41:41.048054 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.039629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58692 (local address 127.4.61.194:39243)
0808 18:41:41.040593 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.040605 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.040630 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:41:41.040713 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.040719 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.040933 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.041075 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:41.041350 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.042475 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.045348 (+ 2873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.047353 (+ 2005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.047445 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.047585 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.047683 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.047777 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":145,"threads_started":1}
I20260808 18:41:41.049245 28848 tablet_service.cc:1467] Processing CreateTablet for tablet 59be905dca8a487cbf851459cc481ac1 (DEFAULT_TABLE table=test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:41.049230 28419 tablet_service.cc:1467] Processing CreateTablet for tablet 59be905dca8a487cbf851459cc481ac1 (DEFAULT_TABLE table=test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:41.050439 28419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59be905dca8a487cbf851459cc481ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:41.050443 28848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59be905dca8a487cbf851459cc481ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:41.052465 28636 tablet_service.cc:1467] Processing CreateTablet for tablet 59be905dca8a487cbf851459cc481ac1 (DEFAULT_TABLE table=test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:41:41.053411 28636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59be905dca8a487cbf851459cc481ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:41:41.058378 28967 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Bootstrap starting.
I20260808 18:41:41.059058 28969 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap starting.
I20260808 18:41:41.059136 28974 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Bootstrap starting.
I20260808 18:41:41.060690 28967 tablet_bootstrap.cc:654] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:41.061256 28969 tablet_bootstrap.cc:654] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:41.061709 28974 tablet_bootstrap.cc:654] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Neither blocks nor log segments found. Creating new log.
I20260808 18:41:41.061810 28967 log.cc:824] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:41.062507 28969 log.cc:824] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:41.062506 28974 log.cc:824] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Log is configured to *not* fsync() on all Append() calls
I20260808 18:41:41.064263 28974 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: No bootstrap required, opened a new log
I20260808 18:41:41.064289 28967 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: No bootstrap required, opened a new log
I20260808 18:41:41.064419 28974 ts_tablet_manager.cc:1397] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:41:41.064419 28969 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: No bootstrap required, opened a new log
I20260808 18:41:41.064464 28967 ts_tablet_manager.cc:1397] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:41:41.064563 28969 ts_tablet_manager.cc:1397] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:41:41.067284 28974 raft_consensus.cc:348] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.067512 28974 raft_consensus.cc:374] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:41.067564 28974 raft_consensus.cc:729] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb68afc366a340de813322670f483816, State: Initialized, Role: FOLLOWER
I20260808 18:41:41.067978 28974 consensus_queue.cc:260] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.068240 28967 raft_consensus.cc:348] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.068342 28969 raft_consensus.cc:348] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.068552 28967 raft_consensus.cc:374] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:41.068614 28967 raft_consensus.cc:729] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370cc314d01c496699d471286850936e, State: Initialized, Role: FOLLOWER
I20260808 18:41:41.068637 28969 raft_consensus.cc:374] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:41:41.068673 28740 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
I20260808 18:41:41.068711 28969 raft_consensus.cc:729] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e269b59b2b4e8ebef44fd84e82c7fb, State: Initialized, Role: FOLLOWER
I20260808 18:41:41.069021 28974 ts_tablet_manager.cc:1428] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:41.069125 28969 consensus_queue.cc:260] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.069113 28967 consensus_queue.cc:260] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.070041 28969 ts_tablet_manager.cc:1428] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:41:41.070060 28967 ts_tablet_manager.cc:1428] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:41:41.070051 28527 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
I20260808 18:41:41.070302 28945 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
I20260808 18:41:41.120452 28980 raft_consensus.cc:482] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:41:41.120666 28980 raft_consensus.cc:504] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.121771 28980 leader_election.cc:288] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:41:41.125582 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.121971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.4.61.195:58851)
0808 18:41:41.122117 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.122130 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.122228 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.122598 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.122601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.122623 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:41.122726 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.122731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.123579 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.123583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.124443 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.124453 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.125141 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.125145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.125275 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.125304 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.125374 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.125449 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 18:41:41.125628 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.122103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:58851 (local address 127.4.61.194:39243)
0808 18:41:41.122246 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.122251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.122281 (+ 30us) server_negotiation.cc:407] Connection header received
0808 18:41:41.122353 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.122356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.122405 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.122478 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:41.122852 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.123477 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.124570 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.125040 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.125128 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.125170 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.125430 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.125506 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:41:41.125855 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.122290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.4.61.195:58309)
0808 18:41:41.122673 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.122684 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:41:41.122776 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:41:41.122994 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:41:41.122997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:41:41.123015 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:41:41.123128 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.123134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.123861 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.123864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.124699 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:41:41.124710 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.125432 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.125436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:41:41.125537 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.125561 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:41:41.125645 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 18:41:41.125710 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":1,"thread_start_us":111,"threads_started":1}
I20260808 18:41:41.125980 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.122431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:58309 (local address 127.4.61.193:36407)
0808 18:41:41.122555 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.122559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.122771 (+ 212us) server_negotiation.cc:407] Connection header received
0808 18:41:41.122871 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.122874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.122918 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.122972 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:41:41.123211 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.123742 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.124837 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.125292 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.125409 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.125454 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.125791 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.125869 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 18:41:41.126375 28672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59be905dca8a487cbf851459cc481ac1" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb68afc366a340de813322670f483816" is_pre_election: true
I20260808 18:41:41.126477 28453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59be905dca8a487cbf851459cc481ac1" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" is_pre_election: true
I20260808 18:41:41.126685 28672 raft_consensus.cc:2454] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 370cc314d01c496699d471286850936e in term 0.
I20260808 18:41:41.126737 28453 raft_consensus.cc:2454] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 370cc314d01c496699d471286850936e in term 0.
I20260808 18:41:41.127206 28776 leader_election.cc:302] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816; no voters:
I20260808 18:41:41.127472 28980 raft_consensus.cc:2781] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:41:41.127552 28980 raft_consensus.cc:482] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:41:41.127583 28980 raft_consensus.cc:3037] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:41.128624 28980 raft_consensus.cc:504] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.128938 28980 leader_election.cc:288] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 election: Requested vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:41:41.129320 28672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59be905dca8a487cbf851459cc481ac1" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb68afc366a340de813322670f483816"
I20260808 18:41:41.129366 28453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59be905dca8a487cbf851459cc481ac1" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
I20260808 18:41:41.129443 28672 raft_consensus.cc:3037] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:41.129468 28453 raft_consensus.cc:3037] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:41:41.130456 28453 raft_consensus.cc:2454] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 370cc314d01c496699d471286850936e in term 1.
I20260808 18:41:41.130540 28672 raft_consensus.cc:2454] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 370cc314d01c496699d471286850936e in term 1.
I20260808 18:41:41.130734 28776 leader_election.cc:302] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb, 370cc314d01c496699d471286850936e; no voters:
I20260808 18:41:41.130903 28980 raft_consensus.cc:2781] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:41:41.131134 28980 raft_consensus.cc:686] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 1 LEADER]: Becoming Leader. State: Replica: 370cc314d01c496699d471286850936e, State: Running, Role: LEADER
I20260808 18:41:41.131461 28980 consensus_queue.cc:237] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:41:41.134614 28219 catalog_manager.cc:5495] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e reported cstate change: term changed from 0 to 1, leader changed from <none> to 370cc314d01c496699d471286850936e (127.4.61.195). New cstate: current_term: 1 leader_uuid: "370cc314d01c496699d471286850936e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } health_report { overall_health: HEALTHY } } }
I20260808 18:41:41.168780 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.165403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.4.61.195:33071)
0808 18:41:41.165519 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:41:41.165523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:41:41.165535 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:41:41.165609 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:41:41.165611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:41:41.165666 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:41:41.165751 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:41:41.166043 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.166626 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.167421 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:41:41.167635 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:41:41.167712 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:41:41.167943 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:41:41.168419 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:41:41.168511 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:41:41.168566 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 18:41:41.168618 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:41:41.174685 28453 raft_consensus.cc:1261] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Refusing update from remote peer 370cc314d01c496699d471286850936e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:41.174685 28672 raft_consensus.cc:1261] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Refusing update from remote peer 370cc314d01c496699d471286850936e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:41:41.175407 28980 consensus_queue.cc:1035] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:41.175612 28983 consensus_queue.cc:1035] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [LEADER]: Connected to new peer: Peer: permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:41:41.183257 28990 mvcc.cc:205] Tried to move back new op lower bound from 7316334596803776512 to 7316334596637323264. Current Snapshot: MvccSnapshot[applied={T|T < 7316334596803776512}]
I20260808 18:41:41.191156 28219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:41.191306 28219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:41:41.193526 28219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Sending DeleteTablet for 3 replicas of tablet 59be905dca8a487cbf851459cc481ac1
I20260808 18:41:41.194367 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 28312
I20260808 18:41:41.194366 28636 tablet_service.cc:1514] Processing DeleteTablet for tablet 59be905dca8a487cbf851459cc481ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:41 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:58692
I20260808 18:41:41.194367 28419 tablet_service.cc:1514] Processing DeleteTablet for tablet 59be905dca8a487cbf851459cc481ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:41 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:55754
I20260808 18:41:41.201450 28848 tablet_service.cc:1514] Processing DeleteTablet for tablet 59be905dca8a487cbf851459cc481ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:41 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45208
I20260808 18:41:41.207079 29000 tablet_replica.cc:330] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: stopping tablet replica
I20260808 18:41:41.207448 29000 raft_consensus.cc:2229] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:41:41.207821 29000 raft_consensus.cc:2258] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:41.211727 29000 ts_tablet_manager.cc:1905] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:41.214226 29000 ts_tablet_manager.cc:1918] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:41.214376 29000 log.cc:1196] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/59be905dca8a487cbf851459cc481ac1
I20260808 18:41:41.214663 29000 ts_tablet_manager.cc:1939] T 59be905dca8a487cbf851459cc481ac1 P 370cc314d01c496699d471286850936e: Deleting consensus metadata
I20260808 18:41:41.215932 28193 catalog_manager.cc:4841] TS 370cc314d01c496699d471286850936e (127.4.61.195:33071): tablet 59be905dca8a487cbf851459cc481ac1 (table test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]) successfully deleted
I20260808 18:41:41.218286 28999 tablet_replica.cc:330] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: stopping tablet replica
I20260808 18:41:41.218654 28999 raft_consensus.cc:2229] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:41:41.218964 28999 raft_consensus.cc:2258] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:41:41.221391 28999 ts_tablet_manager.cc:1905] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:41:41.224114 28999 ts_tablet_manager.cc:1918] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:41:41.224218 28999 log.cc:1196] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/59be905dca8a487cbf851459cc481ac1
I20260808 18:41:41.224516 28999 ts_tablet_manager.cc:1939] T 59be905dca8a487cbf851459cc481ac1 P bb68afc366a340de813322670f483816: Deleting consensus metadata
I20260808 18:41:41.225857 28189 catalog_manager.cc:4841] TS bb68afc366a340de813322670f483816 (127.4.61.194:39243): tablet 59be905dca8a487cbf851459cc481ac1 (table test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]) successfully deleted
W20260808 18:41:41.227433 28189 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:36407 (error 108)
I20260808 18:41:41.228293 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 28536
I20260808 18:41:41.228538 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:41:41.228214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.0.0.1:55758)
0808 18:41:41.228365 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 18:41:41.228450 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 18:41:41.230072 28189 catalog_manager.cc:4584] TS 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 59be905dca8a487cbf851459cc481ac1: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36407: connect: Connection refused (error 111)
I20260808 18:41:41.238883 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 28749
I20260808 18:41:41.249230 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 28168
I20260808 18:42:01.262687 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--webserver_interface=127.4.61.254
--webserver_port=44911
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:01.387708 29002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:01.387993 29002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:01.388058 29002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:01.392117 29002 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 18:42:01.392184 29002 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 18:42:01.392207 29002 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 18:42:01.392225 29002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:01.392248 29002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:01.392277 29002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:01.392308 29002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:01.392334 29002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:01.397796 29002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:01.399019 29002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:01.400110 29002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:01.414206 29016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.414372 29019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.414399 29017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:01.414374 29002 server_base.cc:1034] running on GCE node
I20260808 18:42:01.415165 29002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:01.416495 29002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:01.417658 29002 hybrid_clock.cc:648] HybridClock initialized: now 1786214521417620 us; error 57 us; skew 500 ppm
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:01.420595 29002 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:42:01.421543 29002 webserver.cc:460] Webserver started at http://127.4.61.254:44911/ using document root <none> and password file <none>
I20260808 18:42:01.422124 29002 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:01.422210 29002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:01.426303 29002 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:01.428586 29028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:01.429838 29002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:01.429963 29002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "e01d23cc8ffd4ef694740e6dc109d268"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d39bb1181e26302d7ed20fdf2329d0d5"
server_key_iv: "ddd1ae6f1326f583ebc91e344f6f4967"
server_key_version: "encryptionkey@0"
I20260808 18:42:01.430635 29002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:01.452940 29002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:01.456012 29002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:01.456316 29002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:01.463614 29002 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40853
I20260808 18:42:01.463891 29101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40853 every 8 connection(s)
I20260808 18:42:01.464783 29002 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:01.469394 29102 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:42:01.471185 29102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap starting.
I20260808 18:42:01.471743 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29002
I20260808 18:42:01.472286 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:36407
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=40079
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:42:01.489363 29102 log.cc:824] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:01.498490 29102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:42:01.498849 29102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap complete.
I20260808 18:42:01.502899 29102 raft_consensus.cc:348] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:01.503297 29102 raft_consensus.cc:729] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Initialized, Role: FOLLOWER
I20260808 18:42:01.503786 29102 consensus_queue.cc:260] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:01.503911 29102 raft_consensus.cc:388] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:01.503983 29102 raft_consensus.cc:482] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:01.504071 29102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 1 FOLLOWER]: Advancing to term 2
I20260808 18:42:01.505882 29102 raft_consensus.cc:504] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:01.506197 29102 leader_election.cc:302] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e01d23cc8ffd4ef694740e6dc109d268; no voters:
I20260808 18:42:01.506542 29102 leader_election.cc:288] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 18:42:01.506615 29106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 18:42:01.506855 29106 raft_consensus.cc:686] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 LEADER]: Becoming Leader. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Running, Role: LEADER
I20260808 18:42:01.507226 29106 consensus_queue.cc:237] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:01.507781 29102 sys_catalog.cc:564] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:01.508678 29108 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e01d23cc8ffd4ef694740e6dc109d268. Latest consensus state: current_term: 2 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:42:01.508805 29108 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:01.508728 29107 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:42:01.508865 29107 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:01.509184 29119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:01.513947 29119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:01.514667 29119 catalog_manager.cc:1259] Loaded cluster ID: fcaef2db427747be84af4974a9d46c5f
I20260808 18:42:01.514783 29119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:01.517437 29119 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:01.518214 29119 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Loaded TSK: 0
I20260808 18:42:01.539503 29119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Generated new TSK 1
I20260808 18:42:01.539752 29119 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:42:01.588195 29104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:01.588451 29104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:01.588513 29104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:01.592507 29104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:01.592566 29104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:01.592644 29104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:01.597729 29104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:36407
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=40079
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:01.598809 29104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:01.599774 29104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:01.610227 29143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.610486 29144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.610724 29149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:01.610777 29104 server_base.cc:1034] running on GCE node
I20260808 18:42:01.611192 29104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:01.611837 29104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:01.613013 29104 hybrid_clock.cc:648] HybridClock initialized: now 1786214521612991 us; error 33 us; skew 500 ppm
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:01.615751 29104 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:42:01.616742 29104 webserver.cc:460] Webserver started at http://127.4.61.193:40079/ using document root <none> and password file <none>
I20260808 18:42:01.617300 29104 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:01.617376 29104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:01.621330 29104 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:42:01.623556 29158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:01.624864 29104 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:01.624977 29104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "87429d1983bab9933a774d0c69b8bc80"
server_key_iv: "14a993bd891c058d3aac35c4c44fd110"
server_key_version: "encryptionkey@0"
I20260808 18:42:01.625514 29104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:01.643961 29104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:01.647233 29104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:01.647418 29104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:01.648039 29104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:01.649186 29167 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 18:42:01.653231 29104 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 18:42:01.653288 29104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 18:42:01.653337 29104 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 18:42:01.655071 29104 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 18:42:01.655128 29104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:01.655429 29167 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap starting.
I20260808 18:42:01.665589 29104 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:36407
I20260808 18:42:01.665601 29333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:36407 every 8 connection(s)
I20260808 18:42:01.666864 29104 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:01.670131 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29104
I20260808 18:42:01.670684 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:39243
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=42415
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:42:01.676905 29167 log.cc:824] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:01.685345 29167 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:42:01.685794 29167 tablet_bootstrap.cc:492] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap complete.
I20260808 18:42:01.686196 29337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.669449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:51133)
0808 18:42:01.669945 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:01.670001 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:01.670939 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:01.672357 (+ 1418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:01.672365 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:01.672869 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:01.673505 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.673525 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.675571 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.675574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.676466 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.676476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.677228 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.677233 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.677420 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.678117 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:01.678139 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:01.680046 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:01.682568 (+ 2522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.682590 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.682606 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.682991 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.683415 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.683419 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.683421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.683610 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.684308 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:01.684315 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:01.684632 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 18:42:01.684859 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 18:42:01.685209 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":124,"threads_started":1}
I20260808 18:42:01.686626 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.669501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51133 (local address 127.4.61.254:40853)
0808 18:42:01.671375 (+ 1874us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:01.671390 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:01.671426 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:42:01.671633 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:01.671644 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:01.671923 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:01.672234 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:01.673722 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.675429 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.676597 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.677092 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.677249 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.680269 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:01.680276 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:01.680292 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:01.680325 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:01.682382 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.683130 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.683137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.683142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.683304 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.683716 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.683719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.683721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.684180 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:01.684316 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:01.684995 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 18:42:01.685304 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1732,"thread_start_us":131,"threads_started":1}
I20260808 18:42:01.687141 29167 ts_tablet_manager.cc:1397] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent bootstrapping tablet: real 0.032s user 0.019s sys 0.012s
I20260808 18:42:01.689200 29335 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
I20260808 18:42:01.689442 29335 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:01.690003 29335 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:42:01.689893 29167 raft_consensus.cc:348] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:42:01.690373 29167 raft_consensus.cc:729] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e269b59b2b4e8ebef44fd84e82c7fb, State: Initialized, Role: FOLLOWER
I20260808 18:42:01.690835 29167 consensus_queue.cc:260] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } }
I20260808 18:42:01.692811 29167 ts_tablet_manager.cc:1428] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:42:01.693395 29053 ts_manager.cc:194] Registered new tserver with Master: 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:42:01.696717 29053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:51133
I20260808 18:42:01.699496 29335 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.193@KRBTEST.COM
I20260808 18:42:01.706670 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.696211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.0.0.1:42858)
0808 18:42:01.696967 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:01.697009 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:01.697157 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:01.697642 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:01.697649 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:01.698076 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:01.698186 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.698193 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.699183 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.699187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.699891 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.699903 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.700628 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.700632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.700741 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.701304 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:01.701316 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:01.702960 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:01.704763 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.704773 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.704779 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.705087 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.705453 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.705456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.705458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.705555 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.705981 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:01.705986 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:01.706115 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 18:42:01.706258 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 18:42:01.706489 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":92,"threads_started":1}
I20260808 18:42:01.706756 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.696317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42858 (local address 127.4.61.193:36407)
0808 18:42:01.696700 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:01.696711 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:01.697106 (+ 395us) server_negotiation.cc:407] Connection header received
0808 18:42:01.697299 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:01.697304 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:01.697502 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:01.697639 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:01.698306 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.699071 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.700001 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.700497 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.700601 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.703118 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:01.703134 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:01.703144 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:01.703178 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:01.704651 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.705234 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.705259 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.705260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.705361 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.705635 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.705637 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.705638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.705882 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:01.705982 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:01.706453 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 18:42:01.706610 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":294,"thread_start_us":100,"threads_started":1}
I20260808 18:42:01.707840 29233 tablet_service.cc:1514] Processing DeleteTablet for tablet 59be905dca8a487cbf851459cc481ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:41:41 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260808 18:42:01.708791 29347 tablet_replica.cc:330] stopping tablet replica
I20260808 18:42:01.709089 29347 raft_consensus.cc:2229] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:01.709398 29347 raft_consensus.cc:2258] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:01.710482 29347 ts_tablet_manager.cc:1905] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:01.714195 29347 ts_tablet_manager.cc:1918] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:01.714293 29347 log.cc:1196] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal/wals/59be905dca8a487cbf851459cc481ac1
I20260808 18:42:01.714576 29347 ts_tablet_manager.cc:1939] T 59be905dca8a487cbf851459cc481ac1 P 21e269b59b2b4e8ebef44fd84e82c7fb: Deleting consensus metadata
I20260808 18:42:01.716297 29029 catalog_manager.cc:4841] TS 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407): tablet 59be905dca8a487cbf851459cc481ac1 (table test-table [id=7a63ba3b30ed4d0eb4ce95f3e1bdad69]) successfully deleted
W20260808 18:42:01.794178 29340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:01.794457 29340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:01.794502 29340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:01.798470 29340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:01.798522 29340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:01.798583 29340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:01.803756 29340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:39243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=42415
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:01.804754 29340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:01.805902 29340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:01.815610 29358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.815604 29353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:01.815601 29356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:01.815791 29340 server_base.cc:1034] running on GCE node
I20260808 18:42:01.816301 29340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:01.817009 29340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:01.818159 29340 hybrid_clock.cc:648] HybridClock initialized: now 1786214521818132 us; error 39 us; skew 500 ppm
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:01.820830 29340 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:42:01.821686 29340 webserver.cc:460] Webserver started at http://127.4.61.194:42415/ using document root <none> and password file <none>
I20260808 18:42:01.822228 29340 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:01.822300 29340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:01.826129 29340 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 18:42:01.828349 29367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:01.829798 29340 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:42:01.829916 29340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "bb68afc366a340de813322670f483816"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d1f8aae0ad5bdb6cf0647a6a236eadbc"
server_key_iv: "eaba03d21d032abdf28517297a34f4fd"
server_key_version: "encryptionkey@0"
I20260808 18:42:01.830525 29340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:01.849911 29340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:01.853070 29340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:01.853253 29340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:01.853837 29340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:01.854687 29340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:01.854734 29340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:01.854789 29340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:01.854817 29340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:01.863698 29340 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:39243
I20260808 18:42:01.863724 29546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:39243 every 8 connection(s)
I20260808 18:42:01.864698 29340 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:01.870649 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29340
I20260808 18:42:01.871073 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:33071
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=42259
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 18:42:01 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214521, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:01.877976 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.866505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:57335 (local address 127.4.61.254:40853)
0808 18:42:01.866657 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:01.866661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:01.867541 (+ 880us) server_negotiation.cc:407] Connection header received
0808 18:42:01.868797 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:01.868799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:01.868852 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:01.868929 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:01.870027 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.870675 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.871882 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.872207 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.872313 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.874603 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:01.874605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:01.874608 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:01.874633 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:01.875964 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.876453 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.876456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.876457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.876536 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:01.876852 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:01.876855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:01.876857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:01.877051 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:01.877137 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:01.877644 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 18:42:01.877782 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 18:42:01.878813 29551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:01.866915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:57335)
0808 18:42:01.867360 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:01.867407 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:01.868604 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:01.869084 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:01.869090 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:01.869433 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:01.869912 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.869926 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.870800 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.870804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.871754 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:01.871764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:01.872337 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:01.872340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:01.872478 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:01.873015 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:01.873032 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:01.874442 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:01.876076 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.876082 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.876097 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.876350 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.876618 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:01.876621 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:01.876624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:01.876765 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:01.877152 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:01.877158 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:01.877417 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 18:42:01.877585 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 18:42:01.877908 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":116,"threads_started":1}
I20260808 18:42:01.879953 29547 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
I20260808 18:42:01.880184 29547 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:01.880666 29547 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:42:01.881855 29053 ts_manager.cc:194] Registered new tserver with Master: bb68afc366a340de813322670f483816 (127.4.61.194:39243)
I20260808 18:42:01.882637 29053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:57335
W20260808 18:42:01.983044 29553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:01.983305 29553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:01.983347 29553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:01.987331 29553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:01.987396 29553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:01.987457 29553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:01.992803 29553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:33071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=42259
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:01.993830 29553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:01.994874 29553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:02.004303 29561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:02.004313 29565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:02.004470 29553 server_base.cc:1034] running on GCE node
W20260808 18:42:02.004315 29563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:02.005090 29553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:02.005726 29553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:02.006889 29553 hybrid_clock.cc:648] HybridClock initialized: now 1786214522006854 us; error 45 us; skew 500 ppm
Aug 08 18:42:02 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214522, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:02.009605 29553 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:42:02.010526 29553 webserver.cc:460] Webserver started at http://127.4.61.195:42259/ using document root <none> and password file <none>
I20260808 18:42:02.011080 29553 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:02.011164 29553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:02.014987 29553 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:02.017064 29574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:02.018417 29553 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:02.018519 29553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "370cc314d01c496699d471286850936e"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "096b32495b6e90b9ba22ee5ce9953f30"
server_key_iv: "398e0452b025daba79cb83868eb75704"
server_key_version: "encryptionkey@0"
I20260808 18:42:02.019063 29553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:02.031198 29553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:02.034454 29553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:02.034652 29553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:02.035244 29553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:02.036089 29553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:02.036139 29553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:02.036195 29553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:02.036224 29553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:02.044899 29553 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:33071
I20260808 18:42:02.044955 29757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:33071 every 8 connection(s)
I20260808 18:42:02.045948 29553 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:02.048273 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29553
Aug 08 18:42:02 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214522, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:02.058274 29766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.048952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50614 (local address 127.4.61.254:40853)
0808 18:42:02.049184 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.049189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.049487 (+ 298us) server_negotiation.cc:407] Connection header received
0808 18:42:02.049642 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.049645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.049694 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.049786 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:02.050713 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.051343 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.052443 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.052789 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.052888 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.054816 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:02.054819 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:02.054821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:02.054834 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:02.056335 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.056838 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.056841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.056842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.056934 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.057253 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.057257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.057259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.057498 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:02.057726 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.057899 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.058053 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":86,"threads_started":1}
I20260808 18:42:02.060740 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.047923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:56201 (local address 127.4.61.254:40853)
0808 18:42:02.048089 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.048095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.048924 (+ 829us) server_negotiation.cc:407] Connection header received
0808 18:42:02.050740 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.050743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.050790 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.050864 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:02.052183 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.052850 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.054430 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.054643 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.054719 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.057187 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:02.057189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:02.057191 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:02.057211 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:02.058775 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.059266 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.059270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.059272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.059351 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.059680 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.059684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.059686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.059861 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:02.059948 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.060466 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.060587 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:02.061581 29763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.048266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:56201)
0808 18:42:02.048761 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.048818 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.050520 (+ 1702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.051029 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.051036 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.051373 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:02.052035 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.052054 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.052959 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.052962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.054287 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.054297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.054761 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.054764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.054914 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.055516 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:02.055531 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:02.057014 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:02.058893 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:02.058900 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:02.058914 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:02.059170 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:02.059441 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:02.059444 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:02.059447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:02.059590 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:02.059963 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:02.059970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:02.060227 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.060401 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.060748 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":126,"threads_started":1}
I20260808 18:42:02.062666 29758 heartbeater.cc:347] Connected to a master server at 127.4.61.254:40853
I20260808 18:42:02.062906 29758 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:02.063431 29758 heartbeater.cc:511] Master 127.4.61.254:40853 requested a full tablet report, sending...
I20260808 18:42:02.064426 29053 ts_manager.cc:194] Registered new tserver with Master: 370cc314d01c496699d471286850936e (127.4.61.195:33071)
I20260808 18:42:02.064976 29053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:56201
I20260808 18:42:02.071628 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:02.075562 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.072201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50624 (local address 127.4.61.254:40853)
0808 18:42:02.072320 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.072324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.072540 (+ 216us) server_negotiation.cc:407] Connection header received
0808 18:42:02.072702 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.072705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.072798 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.072880 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:02.073129 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.073619 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.074492 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.074697 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.074779 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.075069 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:02.075196 (+ 127us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 18:42:02.075442 (+ 246us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50624: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 18:42:02.075624 29338 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50624: token expired
W20260808 18:42:02.075901 28949 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.61.254:40853)
I20260808 18:42:02.082156 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.076220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.4.61.254:40853)
0808 18:42:02.076317 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.076320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.076334 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:42:02.076430 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.076433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.076468 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.076527 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:02.077047 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.077507 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.078220 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.078456 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.078522 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.079656 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:02.079659 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:02.079661 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:02.079682 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:02.080981 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.081295 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.081297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.081298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.081363 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:02.081536 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:02.081538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:02.081539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:02.081687 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:02.081779 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.081920 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.082014 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 18:42:02.084666 29053 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:02.087967 29053 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:02.095546 29233 tablet_service.cc:1467] Processing CreateTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b (DEFAULT_TABLE table=test-table [id=86772389f0184035817d9673d4054c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:02.096231 29233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b2ac8bf0c741139b7ada835cf7171b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:02.099192 29167 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap starting.
I20260808 18:42:02.099598 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.094457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.0.0.1:37214)
0808 18:42:02.094631 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.094646 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.094721 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.095593 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.095596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.095615 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.095728 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.095735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.097029 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.097032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.098023 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.098034 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.099193 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.099196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.099297 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.099349 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.099402 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.099483 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260808 18:42:02.099852 29773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.094905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:33071 (local address 127.0.0.1:43264)
0808 18:42:02.095220 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.095233 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.095314 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.096173 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.096176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.096197 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.096287 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.096292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.097619 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.097623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.098578 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.098587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.099487 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.099491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.099581 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.099608 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.099659 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.099726 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":101,"threads_started":1}
I20260808 18:42:02.100098 29167 tablet_bootstrap.cc:654] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:02.100591 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.094634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37214 (local address 127.4.61.194:39243)
0808 18:42:02.095066 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.095078 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.095103 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:42:02.095189 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.095195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.095446 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.095617 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.095846 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.096905 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.098156 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.099054 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.100095 (+ 1041us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.100307 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.100358 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.100451 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":167,"threads_started":1}
I20260808 18:42:02.100591 29774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.095207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43264 (local address 127.4.61.195:33071)
0808 18:42:02.095574 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.095585 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.095608 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:42:02.095683 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.095688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.096026 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.096181 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.096449 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.097500 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.098693 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.099335 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.100113 (+ 778us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.100279 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.100332 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.100429 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":170,"threads_started":1}
I20260808 18:42:02.101677 29167 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: No bootstrap required, opened a new log
I20260808 18:42:02.101773 29167 ts_tablet_manager.cc:1397] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 18:42:02.102216 29167 raft_consensus.cc:348] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.102368 29167 raft_consensus.cc:374] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:02.102415 29167 raft_consensus.cc:729] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e269b59b2b4e8ebef44fd84e82c7fb, State: Initialized, Role: FOLLOWER
I20260808 18:42:02.102573 29167 consensus_queue.cc:260] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.102941 29167 ts_tablet_manager.cc:1428] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 18:42:02.103413 29651 tablet_service.cc:1467] Processing CreateTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b (DEFAULT_TABLE table=test-table [id=86772389f0184035817d9673d4054c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:02.103358 29449 tablet_service.cc:1467] Processing CreateTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b (DEFAULT_TABLE table=test-table [id=86772389f0184035817d9673d4054c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:02.104351 29651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b2ac8bf0c741139b7ada835cf7171b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:02.104410 29449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b2ac8bf0c741139b7ada835cf7171b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:02.110808 29776 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Bootstrap starting.
I20260808 18:42:02.111102 29343 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:02.111281 29343 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.112254 29343 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
I20260808 18:42:02.112907 29777 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Bootstrap starting.
I20260808 18:42:02.113597 29776 tablet_bootstrap.cc:654] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:02.114337 29776 log.cc:824] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:02.115530 29777 tablet_bootstrap.cc:654] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:02.116629 29777 log.cc:824] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:02.116991 29337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.112430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.4.61.193:56485)
0808 18:42:02.112605 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.112621 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.112709 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.113257 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.113260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.113283 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.113419 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.113427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.114423 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.114426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.115587 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.115598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.116555 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.116559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.116672 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.116710 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.116796 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.116873 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 18:42:02.117468 29776 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: No bootstrap required, opened a new log
I20260808 18:42:02.117452 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.112930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:56485 (local address 127.4.61.194:39243)
0808 18:42:02.113037 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.113041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.113054 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:42:02.113094 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.113097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.113139 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.113216 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.113548 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.114280 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.115700 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.116249 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.116364 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.116417 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.117252 (+ 835us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.117331 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:42:02.117712 29776 ts_tablet_manager.cc:1397] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 18:42:02.118069 29475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb68afc366a340de813322670f483816" is_pre_election: true
I20260808 18:42:02.119460 29778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.112497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:33071 (local address 127.4.61.193:57041)
0808 18:42:02.114928 (+ 2431us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.114943 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.115079 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.115387 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.115389 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.115405 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.115660 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.115667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.117527 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.117530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.118438 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.118451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.119061 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.119065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.119160 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.119179 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.119241 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.119311 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2350,"thread_start_us":100,"threads_started":1}
I20260808 18:42:02.119499 29774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.112853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:57041 (local address 127.4.61.195:33071)
0808 18:42:02.112953 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.112957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.115014 (+ 2057us) server_negotiation.cc:407] Connection header received
0808 18:42:02.115181 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.115184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.115227 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.115270 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.115786 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.116420 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.118564 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.118954 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.119056 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.119103 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.119331 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.119403 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 18:42:02.120004 29161 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260808 18:42:02.121131 29776 raft_consensus.cc:348] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.121304 29777 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: No bootstrap required, opened a new log
I20260808 18:42:02.121367 29776 raft_consensus.cc:374] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:02.121420 29776 raft_consensus.cc:729] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb68afc366a340de813322670f483816, State: Initialized, Role: FOLLOWER
I20260808 18:42:02.121498 29777 ts_tablet_manager.cc:1397] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260808 18:42:02.120361 29679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "370cc314d01c496699d471286850936e" is_pre_election: true
I20260808 18:42:02.121896 29776 consensus_queue.cc:260] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
W20260808 18:42:02.122535 29164 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Illegal state: must be running to vote when last-logged opid is not known
I20260808 18:42:02.122646 29164 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:02.122916 29343 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 18:42:02.123070 29776 ts_tablet_manager.cc:1428] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:42:02.123165 29547 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
I20260808 18:42:02.124207 29777 raft_consensus.cc:348] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.124396 29777 raft_consensus.cc:374] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:02.124451 29777 raft_consensus.cc:729] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370cc314d01c496699d471286850936e, State: Initialized, Role: FOLLOWER
I20260808 18:42:02.124825 29777 consensus_queue.cc:260] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.125612 29758 heartbeater.cc:503] Master 127.4.61.254:40853 was elected leader, sending a full tablet report...
I20260808 18:42:02.125649 29777 ts_tablet_manager.cc:1428] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 18:42:02.165516 29785 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:02.165761 29785 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.167027 29785 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 370cc314d01c496699d471286850936e (127.4.61.195:33071), 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
W20260808 18:42:02.168273 29336 tablet.cc:2369] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:02.170663 29774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.167344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:50625 (local address 127.4.61.195:33071)
0808 18:42:02.167502 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.167507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.167523 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:42:02.167580 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.167583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.167633 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.167716 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.167994 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.168638 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.169715 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.170102 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.170205 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.170263 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.170479 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.170550 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 18:42:02.170663 29551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.167266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:33071 (local address 127.4.61.194:50625)
0808 18:42:02.167389 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.167403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.167494 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.167738 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.167740 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.167760 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.167876 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.167882 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.168745 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.168748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.169593 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.169602 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.170211 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.170214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.170348 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.170373 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.170451 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.170527 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":21}
I20260808 18:42:02.171054 29789 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:02.171160 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.167411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:54487 (local address 127.4.61.193:36407)
0808 18:42:02.167528 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.167532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.167904 (+ 372us) server_negotiation.cc:407] Connection header received
0808 18:42:02.167970 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.167973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.168022 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.168079 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.168373 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.169022 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.170081 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.170606 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.170711 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.170842 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.170978 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.171060 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:02.171255 29679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "bb68afc366a340de813322670f483816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "370cc314d01c496699d471286850936e" is_pre_election: true
I20260808 18:42:02.171255 29789 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.171514 29790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.167281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.4.61.194:54487)
0808 18:42:02.167792 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.167805 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.167892 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.168110 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.168113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.168130 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.168250 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.168256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.169165 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.169167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.169951 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.169960 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.170730 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.170734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.170825 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.170846 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.171291 (+ 445us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.171371 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":144,"thread_start_us":137,"threads_started":1}
I20260808 18:42:02.171769 29679 raft_consensus.cc:2454] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb68afc366a340de813322670f483816 in term 0.
I20260808 18:42:02.172163 29262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "bb68afc366a340de813322670f483816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" is_pre_election: true
I20260808 18:42:02.172429 29262 raft_consensus.cc:2454] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb68afc366a340de813322670f483816 in term 0.
I20260808 18:42:02.172567 29789 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:42:02.172860 29368 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb, bb68afc366a340de813322670f483816; no voters:
I20260808 18:42:02.173465 29785 raft_consensus.cc:2781] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:02.173563 29785 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:02.173621 29785 raft_consensus.cc:3037] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:02.174968 29785 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.175328 29785 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [CANDIDATE]: Term 1 election: Requested vote from peers 370cc314d01c496699d471286850936e (127.4.61.195:33071), 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407)
I20260808 18:42:02.175686 29679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "bb68afc366a340de813322670f483816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "370cc314d01c496699d471286850936e"
I20260808 18:42:02.175727 29262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "bb68afc366a340de813322670f483816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
I20260808 18:42:02.175804 29679 raft_consensus.cc:3037] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:02.175843 29262 raft_consensus.cc:3037] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:02.176308 29763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.172743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.4.61.195:36249)
0808 18:42:02.172849 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.172864 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.172937 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.173398 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.173401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.173414 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.173510 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.173516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.174295 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.174298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.175077 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.175088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.175930 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.175934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.176032 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.176058 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.176128 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.176199 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 18:42:02.176599 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.173026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:36249 (local address 127.4.61.194:39243)
0808 18:42:02.173130 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.173134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.173146 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:42:02.173184 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.173187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.173226 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.173291 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.173624 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.174195 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.175222 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.175711 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.175814 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.175856 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.176440 (+ 584us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.176504 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 18:42:02.177002 29679 raft_consensus.cc:2454] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb68afc366a340de813322670f483816 in term 1.
I20260808 18:42:02.177078 29262 raft_consensus.cc:2454] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb68afc366a340de813322670f483816 in term 1.
I20260808 18:42:02.177196 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.173002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.4.61.195:43251)
0808 18:42:02.173324 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.173336 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:02.173408 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:02.173717 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:02.173720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:02.173739 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:02.173845 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.173851 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.174792 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.174795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.175856 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:02.175868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.176774 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.176778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:02.176877 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.176900 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:42:02.176991 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 18:42:02.177060 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":129,"threads_started":1}
I20260808 18:42:02.177219 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.173362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:43251 (local address 127.4.61.193:36407)
0808 18:42:02.173460 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.173464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.173477 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:42:02.173517 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.173519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.173559 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.173629 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:02.173984 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.174640 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.176021 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.176530 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.176615 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.176658 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.177038 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.177111 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 18:42:02.177304 29375 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816; no voters:
I20260808 18:42:02.177506 29785 raft_consensus.cc:2781] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:02.177716 29475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb68afc366a340de813322670f483816" is_pre_election: true
I20260808 18:42:02.177716 29785 raft_consensus.cc:686] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 1 LEADER]: Becoming Leader. State: Replica: bb68afc366a340de813322670f483816, State: Running, Role: LEADER
I20260808 18:42:02.177839 29262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b2ac8bf0c741139b7ada835cf7171b" candidate_uuid: "370cc314d01c496699d471286850936e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" is_pre_election: true
I20260808 18:42:02.178012 29262 raft_consensus.cc:2379] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 370cc314d01c496699d471286850936e in current term 1: Already voted for candidate bb68afc366a340de813322670f483816 in this term.
I20260808 18:42:02.178161 29785 consensus_queue.cc:237] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:02.180673 29575 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 370cc314d01c496699d471286850936e; no voters: 21e269b59b2b4e8ebef44fd84e82c7fb, bb68afc366a340de813322670f483816
I20260808 18:42:02.180913 29789 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 18:42:02.181918 29053 catalog_manager.cc:5495] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb68afc366a340de813322670f483816 (127.4.61.194). New cstate: current_term: 1 leader_uuid: "bb68afc366a340de813322670f483816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } health_report { overall_health: UNKNOWN } } }
I20260808 18:42:02.209446 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.205797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.4.61.194:39243)
0808 18:42:02.205941 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:02.205946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:02.205961 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:42:02.206094 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:02.206096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:02.206157 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:02.206247 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:02.206537 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.207047 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.207923 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:02.208156 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:02.208243 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:02.208561 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:02.209040 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:02.209153 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:02.209218 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 18:42:02.209278 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:42:02.215441 29262 raft_consensus.cc:1261] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Refusing update from remote peer bb68afc366a340de813322670f483816: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:02.215448 29679 raft_consensus.cc:1261] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Refusing update from remote peer bb68afc366a340de813322670f483816: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:02.216037 29785 consensus_queue.cc:1035] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:02.216240 29798 consensus_queue.cc:1035] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:02.231468 29053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:02.231675 29053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:02.234089 29053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Sending DeleteTablet for 3 replicas of tablet d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:02.234804 29233 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:02 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:42858
I20260808 18:42:02.235013 29449 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:02 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:37214
I20260808 18:42:02.235232 29818 tablet_replica.cc:330] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: stopping tablet replica
I20260808 18:42:02.235263 29651 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b2ac8bf0c741139b7ada835cf7171b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:02 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43264
I20260808 18:42:02.235368 29818 raft_consensus.cc:2229] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:02.235507 29818 raft_consensus.cc:2258] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:02.235900 29819 tablet_replica.cc:330] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: stopping tablet replica
I20260808 18:42:02.235952 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 29104
I20260808 18:42:02.236248 29819 raft_consensus.cc:2229] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:02.236553 29819 raft_consensus.cc:2258] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:02.240186 29820 tablet_replica.cc:330] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: stopping tablet replica
I20260808 18:42:02.240476 29820 raft_consensus.cc:2229] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:02.240743 29820 raft_consensus.cc:2258] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:02.242738 29819 ts_tablet_manager.cc:1905] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:02.245069 29819 ts_tablet_manager.cc:1918] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:02.245160 29819 log.cc:1196] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:02.245469 29819 ts_tablet_manager.cc:1939] T d8b2ac8bf0c741139b7ada835cf7171b P bb68afc366a340de813322670f483816: Deleting consensus metadata
I20260808 18:42:02.247869 29029 catalog_manager.cc:4841] TS bb68afc366a340de813322670f483816 (127.4.61.194:39243): tablet d8b2ac8bf0c741139b7ada835cf7171b (table test-table [id=86772389f0184035817d9673d4054c4e]) successfully deleted
I20260808 18:42:02.247982 29820 ts_tablet_manager.cc:1905] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:02.250478 29820 ts_tablet_manager.cc:1918] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:02.250581 29820 log.cc:1196] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:02.250866 29820 ts_tablet_manager.cc:1939] T d8b2ac8bf0c741139b7ada835cf7171b P 370cc314d01c496699d471286850936e: Deleting consensus metadata
I20260808 18:42:02.251966 29037 catalog_manager.cc:4841] TS 370cc314d01c496699d471286850936e (127.4.61.195:33071): tablet d8b2ac8bf0c741139b7ada835cf7171b (table test-table [id=86772389f0184035817d9673d4054c4e]) successfully deleted
W20260808 18:42:02.256984 29029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:36407 (error 108)
I20260808 18:42:02.257606 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 29340
I20260808 18:42:02.261600 29773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:02.257768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36407 (local address 127.0.0.1:42866)
0808 18:42:02.261420 (+ 3652us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:02.261508 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3561}
W20260808 18:42:02.264881 29029 catalog_manager.cc:4584] TS 21e269b59b2b4e8ebef44fd84e82c7fb (127.4.61.193:36407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8b2ac8bf0c741139b7ada835cf7171b: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36407: connect: Connection refused (error 111)
I20260808 18:42:02.270527 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 29553
I20260808 18:42:02.289849 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 29002
I20260808 18:42:22.302533 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--webserver_interface=127.4.61.254
--webserver_port=44911
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:22.413947 29822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:22.414201 29822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:22.414247 29822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:22.418291 29822 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 18:42:22.418365 29822 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 18:42:22.418380 29822 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 18:42:22.418391 29822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:22.418408 29822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:22.418427 29822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:22.418458 29822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:22.418478 29822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:22.423698 29822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:22.424736 29822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:22.425735 29822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:22.434337 29832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:22.434376 29829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:22.434388 29830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:22.434553 29822 server_base.cc:1034] running on GCE node
I20260808 18:42:22.435149 29822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:22.436242 29822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:22.437422 29822 hybrid_clock.cc:648] HybridClock initialized: now 1786214542437408 us; error 30 us; skew 500 ppm
Aug 08 18:42:22 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214542, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:22.445101 29822 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:42:22.446048 29822 webserver.cc:460] Webserver started at http://127.4.61.254:44911/ using document root <none> and password file <none>
I20260808 18:42:22.446638 29822 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:22.446710 29822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:22.450532 29822 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260808 18:42:22.452615 29849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:22.453809 29822 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:22.453927 29822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "e01d23cc8ffd4ef694740e6dc109d268"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d39bb1181e26302d7ed20fdf2329d0d5"
server_key_iv: "ddd1ae6f1326f583ebc91e344f6f4967"
server_key_version: "encryptionkey@0"
I20260808 18:42:22.454517 29822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:22.468394 29822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:22.471412 29822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:22.471588 29822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:22.478780 29822 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40853
I20260808 18:42:22.479038 29940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40853 every 8 connection(s)
I20260808 18:42:22.479883 29822 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:22.484230 29941 sys_catalog.cc:263] Verifying existing consensus state
I20260808 18:42:22.485918 29941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap starting.
I20260808 18:42:22.490029 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29822
I20260808 18:42:22.490602 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:36407
--local_ip_for_outbound_sockets=127.4.61.193
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=40079
--webserver_interface=127.4.61.193
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:42:22.504385 29941 log.cc:824] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:22.515805 29941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:42:22.516156 29941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Bootstrap complete.
I20260808 18:42:22.520123 29941 raft_consensus.cc:348] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:22.520514 29941 raft_consensus.cc:729] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Initialized, Role: FOLLOWER
I20260808 18:42:22.520991 29941 consensus_queue.cc:260] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:22.521111 29941 raft_consensus.cc:388] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:22.521173 29941 raft_consensus.cc:482] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:22.521270 29941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 2 FOLLOWER]: Advancing to term 3
I20260808 18:42:22.523203 29941 raft_consensus.cc:504] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:22.523527 29941 leader_election.cc:302] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e01d23cc8ffd4ef694740e6dc109d268; no voters:
I20260808 18:42:22.523813 29941 leader_election.cc:288] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 18:42:22.523943 29948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 18:42:22.524183 29948 raft_consensus.cc:686] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [term 3 LEADER]: Becoming Leader. State: Replica: e01d23cc8ffd4ef694740e6dc109d268, State: Running, Role: LEADER
I20260808 18:42:22.524571 29948 consensus_queue.cc:237] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } }
I20260808 18:42:22.525018 29941 sys_catalog.cc:564] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:22.526091 29950 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e01d23cc8ffd4ef694740e6dc109d268. Latest consensus state: current_term: 3 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:42:22.526124 29949 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e01d23cc8ffd4ef694740e6dc109d268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01d23cc8ffd4ef694740e6dc109d268" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40853 } } }
I20260808 18:42:22.526216 29950 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:22.526224 29949 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:22.526582 29961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:22.531710 29961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:22.532402 29961 catalog_manager.cc:1259] Loaded cluster ID: fcaef2db427747be84af4974a9d46c5f
I20260808 18:42:22.532500 29961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:22.534962 29961 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:22.535741 29961 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Loaded TSK: 0
I20260808 18:42:22.535902 29961 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e01d23cc8ffd4ef694740e6dc109d268: Loaded TSK: 1
F20260808 18:42:22.536726 29961 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f748af699ad google::LogMessage::Fail() at ??:0
@ 0x7f748af6c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f748af694de google::LogMessage::Flush() at ??:0
@ 0x7f748af6aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f748dc2d18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f748dc25f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f74958ce7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f74958a899c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f74958a9178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f74958eadf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f749590982b std::function<>::operator()() at ??:0
@ 0x7f74958a8b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f74958a9f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f74958a6579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f74958ea640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f748d1bb3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f748d1bbc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f748d1bd3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f748d1ac512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f748e7f06db start_thread at ??:0
@ 0x7f7489a6761f clone at ??:0
W20260808 18:42:22.632311 29946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:22.632546 29946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:22.632588 29946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:22.636736 29946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:22.636791 29946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:22.636853 29946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:22.642400 29946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:36407
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=40079
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:22.643556 29946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:22.644553 29946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:22.654805 30027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:22.654793 30028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:22.654976 29946 server_base.cc:1034] running on GCE node
W20260808 18:42:22.655189 30031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:22.655640 29946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:22.656414 29946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:22.657616 29946 hybrid_clock.cc:648] HybridClock initialized: now 1786214542657586 us; error 36 us; skew 500 ppm
Aug 08 18:42:22 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214542, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:22.661021 29946 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:42:22.661924 29946 webserver.cc:460] Webserver started at http://127.4.61.193:40079/ using document root <none> and password file <none>
I20260808 18:42:22.662539 29946 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:22.662606 29946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:22.666777 29946 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:22.669063 30044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:22.670426 29946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:22.670536 29946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "21e269b59b2b4e8ebef44fd84e82c7fb"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "87429d1983bab9933a774d0c69b8bc80"
server_key_iv: "14a993bd891c058d3aac35c4c44fd110"
server_key_version: "encryptionkey@0"
I20260808 18:42:22.671085 29946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:22.688235 29946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:22.695452 29946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:22.695657 29946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:22.696405 29946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:22.697582 30055 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 18:42:22.703312 29946 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 18:42:22.703416 29946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 18:42:22.703492 29946 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 18:42:22.705250 29946 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 18:42:22.705302 29946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 18:42:22.705680 30055 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap starting.
I20260808 18:42:22.715678 29946 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:36407
I20260808 18:42:22.715706 30249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:36407 every 8 connection(s)
I20260808 18:42:22.716671 29946 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:22.718586 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 29946
I20260808 18:42:22.719115 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:39243
--local_ip_for_outbound_sockets=127.4.61.194
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=42415
--webserver_interface=127.4.61.194
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:42:22.725811 30055 log.cc:824] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:22.732859 30055 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 18:42:22.733214 30055 tablet_bootstrap.cc:492] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Bootstrap complete.
I20260808 18:42:22.734169 30055 ts_tablet_manager.cc:1397] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.011s
I20260808 18:42:22.736764 30055 raft_consensus.cc:348] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:22.737208 30055 raft_consensus.cc:729] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e269b59b2b4e8ebef44fd84e82c7fb, State: Initialized, Role: FOLLOWER
I20260808 18:42:22.737727 30055 consensus_queue.cc:260] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:22.738806 30055 ts_tablet_manager.cc:1428] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260808 18:42:22.795074 30255 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:42:22.719102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:41753)
0808 18:42:22.720381 (+ 1279us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.720439 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:22.721513 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:22.794226 (+ 72713us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1030,"thread_start_us":141,"threads_started":1}
W20260808 18:42:22.795701 30250 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:40853 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:40853: Client connection negotiation failed: client connection to 127.4.61.254:40853: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 18:42:22.796510 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:22.796218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:49863)
0808 18:42:22.796380 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.796450 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 18:42:22.797166 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:22.796985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:45087)
0808 18:42:22.797076 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.797115 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 18:42:22.797349 30250 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 18:42:22.861316 30257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:22.861598 30257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:22.861660 30257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:22.866379 30257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:22.866448 30257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:22.866546 30257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:22.873637 30257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:39243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=42415
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:22.874904 30257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:22.876024 30257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:22.886366 30269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:22.886373 30266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:22.886490 30267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:22.886790 30257 server_base.cc:1034] running on GCE node
I20260808 18:42:22.887187 30257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:22.887801 30257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:22.888957 30257 hybrid_clock.cc:648] HybridClock initialized: now 1786214542888931 us; error 45 us; skew 500 ppm
Aug 08 18:42:22 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214542, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:22.891647 30257 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:42:22.892637 30257 webserver.cc:460] Webserver started at http://127.4.61.194:42415/ using document root <none> and password file <none>
I20260808 18:42:22.893178 30257 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:22.893244 30257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:22.897002 30257 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:22.899171 30279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:22.900388 30257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:22.900512 30257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "bb68afc366a340de813322670f483816"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "d1f8aae0ad5bdb6cf0647a6a236eadbc"
server_key_iv: "eaba03d21d032abdf28517297a34f4fd"
server_key_version: "encryptionkey@0"
I20260808 18:42:22.901106 30257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:22.913442 30257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:22.916131 30257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:22.916296 30257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:22.916859 30257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:22.917647 30257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:22.917695 30257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:22.917747 30257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:22.917775 30257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:22.926714 30257 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:39243
I20260808 18:42:22.926764 30461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:39243 every 8 connection(s)
I20260808 18:42:22.927716 30257 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:22.931550 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:22.929752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:52629)
0808 18:42:22.930180 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.930285 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":111,"threads_started":1}
W20260808 18:42:22.931991 30462 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:40853 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:40853: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
I20260808 18:42:22.932567 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:22.932355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:53767)
0808 18:42:22.932465 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.932512 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 18:42:22.933139 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:22.932955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:33583)
0808 18:42:22.933049 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:22.933092 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 18:42:22.933282 30462 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 18:42:22.934026 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 30257
I20260808 18:42:22.934541 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:33071
--local_ip_for_outbound_sockets=127.4.61.195
--tserver_master_addrs=127.4.61.254:40853
--webserver_port=42259
--webserver_interface=127.4.61.195
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:23.045898 30467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:23.046175 30467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:23.046233 30467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:23.050215 30467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:23.050285 30467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:23.050382 30467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:23.055671 30467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:33071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=42259
--tserver_master_addrs=127.4.61.254:40853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:23.056684 30467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:23.057682 30467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:23.067234 30473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:23.067227 30478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:23.067317 30474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:23.067538 30467 server_base.cc:1034] running on GCE node
I20260808 18:42:23.067914 30467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:23.068557 30467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:23.069727 30467 hybrid_clock.cc:648] HybridClock initialized: now 1786214543069707 us; error 27 us; skew 500 ppm
Aug 08 18:42:23 dist-test-slave-fgb3 krb5kdc[28147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214543, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:23.072536 30467 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:42:23.073451 30467 webserver.cc:460] Webserver started at http://127.4.61.195:42259/ using document root <none> and password file <none>
I20260808 18:42:23.074030 30467 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:23.074100 30467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:23.078184 30467 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:23.080310 30489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:23.081508 30467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:23.081611 30467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "370cc314d01c496699d471286850936e"
format_stamp: "Formatted at 2026-08-08 18:41:40 on dist-test-slave-fgb3"
server_key: "096b32495b6e90b9ba22ee5ce9953f30"
server_key_iv: "398e0452b025daba79cb83868eb75704"
server_key_version: "encryptionkey@0"
I20260808 18:42:23.082158 30467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:23.091847 30467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:23.094900 30467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:23.095053 30467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:23.095587 30467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:23.096375 30467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:23.096434 30467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:23.096474 30467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:23.096494 30467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:23.105209 30467 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:33071
I20260808 18:42:23.105253 30656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:33071 every 8 connection(s)
I20260808 18:42:23.106261 30467 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:23.110235 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:23.108453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:49089)
0808 18:42:23.108948 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:23.109061 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":125,"threads_started":1}
W20260808 18:42:23.110801 30657 heartbeater.cc:644] Failed to heartbeat to 127.4.61.254:40853 (0 consecutive failures): Network error: Failed to ping master at 127.4.61.254:40853: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
I20260808 18:42:23.111388 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:23.111175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:54357)
0808 18:42:23.111282 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:23.111331 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 18:42:23.111806 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 30467
I20260808 18:42:23.112021 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:23.111791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:36063)
0808 18:42:23.111908 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:23.111962 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 18:42:23.112187 30657 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 18:42:23.798554 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:23.798025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:60259)
0808 18:42:23.798361 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:23.798427 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260808 18:42:23.934231 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:23.933840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:45341)
0808 18:42:23.934082 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:23.934131 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":87,"threads_started":1}
I20260808 18:42:24.086607 30668 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:24.086807 30668 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:24.087898 30668 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
Aug 08 18:42:24 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214542, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.195@KRBTEST.COM
Aug 08 18:42:24 dist-test-slave-fgb3 krb5kdc[28147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214542, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.194@KRBTEST.COM
I20260808 18:42:24.101131 30672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.088129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:39243 (local address 127.4.61.193:60271)
0808 18:42:24.088799 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:24.088810 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:24.088910 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:24.090161 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:24.090164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:24.090602 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:24.091089 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:24.091103 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.092351 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.092354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:24.093320 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:24.093330 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.094011 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.094015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:24.094236 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:24.094930 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:24.094943 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:24.096845 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:24.098847 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:24.098851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:24.098853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:24.099108 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:24.099423 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:24.099428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:24.099565 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:24.100168 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:24.100175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:24.100416 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 18:42:24.100581 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 18:42:24.100931 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":606,"spinlock_wait_cycles":38272,"thread_start_us":79,"threads_started":1}
I20260808 18:42:24.101142 30670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.088332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:60271 (local address 127.4.61.194:39243)
0808 18:42:24.088663 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:24.088690 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:24.088903 (+ 213us) server_negotiation.cc:407] Connection header received
0808 18:42:24.089589 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:24.089595 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:24.089896 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:24.090188 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:24.091251 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.092209 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.093436 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.093893 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.094032 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:24.097009 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:24.097013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:24.097024 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:24.097051 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:24.098722 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099209 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:24.099215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:24.099219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:24.099334 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099651 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:24.099655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:24.099656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:24.100056 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:24.100177 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:24.100710 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 18:42:24.100966 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":92,"threads_started":1}
I20260808 18:42:24.101163 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.088266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:33641 (local address 127.4.61.195:33071)
0808 18:42:24.088556 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:24.088572 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:24.088620 (+ 48us) server_negotiation.cc:407] Connection header received
0808 18:42:24.089336 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:24.089343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:24.089692 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:24.089942 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:24.091252 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.092226 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.093416 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.093900 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.094046 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:24.096755 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:24.096763 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:24.096779 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:24.096814 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:24.098667 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099207 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:24.099213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:24.099219 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:24.099340 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099659 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:24.099662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:24.099664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:24.100056 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:24.100177 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:24.100711 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 18:42:24.100977 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":80,"threads_started":1}
I20260808 18:42:24.101153 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.088129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:33071 (local address 127.4.61.193:33641)
0808 18:42:24.088297 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:24.088312 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:24.088427 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:24.090048 (+ 1621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:24.090053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:24.090615 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:24.091088 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:24.091102 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.092350 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.092353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:24.093300 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:24.093311 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:24.094020 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:24.094024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:24.094233 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:24.094869 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:24.094885 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:24.096520 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:24.098772 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:24.098778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:24.098800 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:24.099103 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:24.099429 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:24.099432 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:24.099434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:24.099572 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:24.100168 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:24.100175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:24.100414 (+ 239us) client_negotiation.cc:769] Sending connection context
0808 18:42:24.100581 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 18:42:24.101005 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":295,"spinlock_wait_cycles":6016}
W20260808 18:42:24.104159 30049 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
W20260808 18:42:24.104367 30046 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:24.104423 30046 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:24.104642 30668 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:42:24.113041 30673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.112700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:37577)
0808 18:42:24.112909 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:24.112957 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
I20260808 18:42:24.799769 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.799356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:35753)
0808 18:42:24.799605 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:24.799664 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":80,"threads_started":1}
I20260808 18:42:24.935392 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:24.934936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:38963)
0808 18:42:24.935203 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:24.935293 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
I20260808 18:42:25.114370 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:25.113844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:40681)
0808 18:42:25.114143 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:25.114208 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":86,"threads_started":1}
I20260808 18:42:25.766712 30680 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:25.766867 30680 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:25.767385 30680 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
W20260808 18:42:25.768347 30049 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
W20260808 18:42:25.768461 30046 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:25.768554 30046 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:25.768715 30680 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:42:25.801075 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:25.800653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:42239)
0808 18:42:25.800916 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:25.800973 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260808 18:42:25.936589 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:25.936109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:41079)
0808 18:42:25.936406 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:25.936467 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":81,"threads_started":1}
I20260808 18:42:26.115626 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:26.115167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:57295)
0808 18:42:26.115466 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:26.115532 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":106,"threads_started":1}
I20260808 18:42:26.802209 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:26.801809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:54835)
0808 18:42:26.802054 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:26.802110 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260808 18:42:26.937891 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:26.937442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:45981)
0808 18:42:26.937716 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:26.937781 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
I20260808 18:42:27.116763 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:27.116348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:37613)
0808 18:42:27.116598 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:27.116666 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":73,"threads_started":1}
I20260808 18:42:27.803627 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:27.803156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:51603)
0808 18:42:27.803462 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:27.803525 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":76,"threads_started":1}
I20260808 18:42:27.939146 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:27.938748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:37681)
0808 18:42:27.939004 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:27.939054 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":78,"threads_started":1}
I20260808 18:42:28.118003 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:28.117547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:60035)
0808 18:42:28.117818 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:28.117880 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
I20260808 18:42:28.512269 30700 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:28.512447 30700 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:28.512919 30700 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
W20260808 18:42:28.513754 30046 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
W20260808 18:42:28.513952 30049 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:28.514101 30049 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:28.514302 30700 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:42:28.805011 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:28.804538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:38385)
0808 18:42:28.804837 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:28.804901 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":90,"threads_started":1}
I20260808 18:42:28.940517 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:28.939986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:45293)
0808 18:42:28.940305 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:28.940376 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":81,"threads_started":1}
I20260808 18:42:29.119329 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:29.118849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:54229)
0808 18:42:29.119158 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:29.119226 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":108,"threads_started":1}
I20260808 18:42:29.806241 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:29.805826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:44833)
0808 18:42:29.806086 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:29.806140 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":85,"threads_started":1}
I20260808 18:42:29.941906 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:29.941387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:35301)
0808 18:42:29.941730 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:29.941799 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":79,"threads_started":1}
I20260808 18:42:30.120599 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:30.120107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:57049)
0808 18:42:30.120436 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:30.120498 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":73,"threads_started":1}
I20260808 18:42:30.807457 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:30.807019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:48957)
0808 18:42:30.807292 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:30.807352 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":91,"threads_started":1}
I20260808 18:42:30.943300 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:30.942773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:35035)
0808 18:42:30.943103 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:30.943172 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":97,"threads_started":1}
I20260808 18:42:30.967042 30711 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:30.967181 30711 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:30.967597 30711 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
W20260808 18:42:30.968350 30046 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
W20260808 18:42:30.968472 30049 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:30.968559 30049 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:30.968703 30711 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:42:31.121797 30712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:31.121365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:42337)
0808 18:42:31.121636 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:31.121696 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":86,"threads_started":1}
I20260808 18:42:31.808621 30713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:31.808170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:41237)
0808 18:42:31.808462 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:31.808522 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":98,"threads_started":1}
I20260808 18:42:31.944670 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:31.944168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:41845)
0808 18:42:31.944500 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:31.944566 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":110,"threads_started":1}
I20260808 18:42:32.123172 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:32.122674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:43163)
0808 18:42:32.122999 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:32.123068 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":114,"threads_started":1}
I20260808 18:42:32.809983 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:32.809532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:53093)
0808 18:42:32.809818 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:32.809878 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":85,"threads_started":1}
I20260808 18:42:32.945892 30717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:32.945499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:37209)
0808 18:42:32.945738 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:32.945791 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":72,"threads_started":1}
I20260808 18:42:33.124434 30718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:33.123952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:35511)
0808 18:42:33.124255 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:33.124329 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":103,"threads_started":1}
I20260808 18:42:33.811388 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:33.810889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:37377)
0808 18:42:33.811182 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:33.811278 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":81,"threads_started":1}
I20260808 18:42:33.947373 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:33.946873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:48897)
0808 18:42:33.947192 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:33.947267 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":111,"threads_started":1}
I20260808 18:42:34.125921 30721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:34.125404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:33869)
0808 18:42:34.125744 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:34.125814 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":98,"threads_started":1}
I20260808 18:42:34.812570 30724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:34.812126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:46139)
0808 18:42:34.812405 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:34.812466 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":76,"threads_started":1}
I20260808 18:42:34.948616 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:34.948165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:46495)
0808 18:42:34.948468 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:34.948521 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":121,"threads_started":1}
I20260808 18:42:35.127283 30727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:35.126802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:38721)
0808 18:42:35.127102 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:35.127175 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":98,"threads_started":1}
I20260808 18:42:35.666591 30729 raft_consensus.cc:482] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:35.666733 30729 raft_consensus.cc:504] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb68afc366a340de813322670f483816" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 39243 } } peers { permanent_uuid: "370cc314d01c496699d471286850936e" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 33071 } } peers { permanent_uuid: "21e269b59b2b4e8ebef44fd84e82c7fb" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36407 } }
I20260808 18:42:35.667186 30729 leader_election.cc:288] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb68afc366a340de813322670f483816 (127.4.61.194:39243), 370cc314d01c496699d471286850936e (127.4.61.195:33071)
W20260808 18:42:35.668116 30049 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 370cc314d01c496699d471286850936e (127.4.61.195:33071): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
W20260808 18:42:35.668236 30046 leader_election.cc:341] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb68afc366a340de813322670f483816 (127.4.61.194:39243): Not found: Tablet not found: d8b2ac8bf0c741139b7ada835cf7171b
I20260808 18:42:35.668344 30046 leader_election.cc:302] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21e269b59b2b4e8ebef44fd84e82c7fb; no voters: 370cc314d01c496699d471286850936e, bb68afc366a340de813322670f483816
I20260808 18:42:35.668488 30729 raft_consensus.cc:2726] T d8b2ac8bf0c741139b7ada835cf7171b P 21e269b59b2b4e8ebef44fd84e82c7fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 18:42:35.813812 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:35.813368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:40795)
0808 18:42:35.813651 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:35.813707 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":99,"threads_started":1}
I20260808 18:42:35.949766 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:35.949306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:42135)
0808 18:42:35.949600 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:35.949662 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":91,"threads_started":1}
I20260808 18:42:36.128463 30735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:36.128037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:37485)
0808 18:42:36.128307 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:36.128360 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":97,"threads_started":1}
I20260808 18:42:36.814975 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:36.814546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:59377)
0808 18:42:36.814812 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:36.814868 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
I20260808 18:42:36.951035 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:36.950544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:34913)
0808 18:42:36.950863 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:36.950929 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":79,"threads_started":1}
I20260808 18:42:37.129640 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:37.129198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:49585)
0808 18:42:37.129481 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:37.129540 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
I20260808 18:42:37.816299 30740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:37.815880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.193:45977)
0808 18:42:37.816138 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:37.816195 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":77,"threads_started":1}
I20260808 18:42:37.952486 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:37.952010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.194:48675)
0808 18:42:37.952322 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:37.952382 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":95,"threads_started":1}
I20260808 18:42:38.115778 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 29946
I20260808 18:42:38.130980 30742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:38.130587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:40853 (local address 127.4.61.195:60935)
0808 18:42:38.130823 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:38.130878 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.254:40853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":66,"threads_started":1}
I20260808 18:42:38.132113 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 30257
I20260808 18:42:38.146097 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 30467
2026-08-08T18:42:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59330 ms)
[----------] 30 tests from SecurityITest (246148 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:38 dist-test-slave-fgb3 krb5kdc[30748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:38 dist-test-slave-fgb3 krb5kdc[30748](info): set up 2 sockets
Aug 08 18:42:38 dist-test-slave-fgb3 krb5kdc[30748](info): commencing operation
krb5kdc: starting...
W20260808 18:42:39.296849 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:39 dist-test-slave-fgb3 krb5kdc[30748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:42:39.415086 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33515
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:33515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:39.525465 30766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:39.525708 30766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:39.525746 30766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:39.529714 30766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:39.529770 30766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:39.529788 30766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:39.529804 30766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:39.529832 30766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:39.534911 30766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:33515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:39.535866 30766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:39.536830 30766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:39.545367 30780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:39.545423 30766 server_base.cc:1034] running on GCE node
W20260808 18:42:39.545389 30773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:39.545614 30774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:39.546185 30766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:39.547334 30766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:39.548507 30766 hybrid_clock.cc:648] HybridClock initialized: now 1786214559548489 us; error 27 us; skew 500 ppm
Aug 08 18:42:39 dist-test-slave-fgb3 krb5kdc[30748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214559, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:39.551112 30766 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:42:39.552000 30766 webserver.cc:460] Webserver started at http://127.4.61.254:43413/ using document root <none> and password file <none>
I20260808 18:42:39.552534 30766 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:39.552600 30766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:39.552811 30766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:39.554862 30766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "e00c6c7eeb7b42408df82dde9c8e672c"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "4d552ba93a25c32aabeb1201b018f7cc"
server_key_iv: "4500422a490738e113ec571afdd23287"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.555408 30766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "e00c6c7eeb7b42408df82dde9c8e672c"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "4d552ba93a25c32aabeb1201b018f7cc"
server_key_iv: "4500422a490738e113ec571afdd23287"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.558969 30766 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:39.561231 30793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:39.562500 30766 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:39.562631 30766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "e00c6c7eeb7b42408df82dde9c8e672c"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "4d552ba93a25c32aabeb1201b018f7cc"
server_key_iv: "4500422a490738e113ec571afdd23287"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.562729 30766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:39.583832 30766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:39.586706 30766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:39.586896 30766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:39.593693 30766 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:33515
I20260808 18:42:39.593714 30871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:33515 every 8 connection(s)
I20260808 18:42:39.594686 30766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:39.597404 30873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:39.600991 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 30766
I20260808 18:42:39.601112 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:39.601418 4343 external_mini_cluster.cc:1428] Setting key 677f0183100fe90081c1382b9a32dde6
I20260808 18:42:39.603034 30873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: Bootstrap starting.
I20260808 18:42:39.605369 30873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:39.606056 30873 log.cc:824] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:39.607995 30873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: No bootstrap required, opened a new log
Aug 08 18:42:39 dist-test-slave-fgb3 krb5kdc[30748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:39.611876 30873 raft_consensus.cc:348] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } }
I20260808 18:42:39.612082 30873 raft_consensus.cc:374] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:39.612126 30873 raft_consensus.cc:729] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00c6c7eeb7b42408df82dde9c8e672c, State: Initialized, Role: FOLLOWER
I20260808 18:42:39.612548 30873 consensus_queue.cc:260] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } }
I20260808 18:42:39.612715 30873 raft_consensus.cc:388] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:39.612787 30873 raft_consensus.cc:482] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:39.612895 30873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:39.613809 30873 raft_consensus.cc:504] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } }
I20260808 18:42:39.614180 30873 leader_election.cc:302] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e00c6c7eeb7b42408df82dde9c8e672c; no voters:
I20260808 18:42:39.614553 30873 leader_election.cc:288] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:39.614661 30880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:39.614871 30880 raft_consensus.cc:686] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [term 1 LEADER]: Becoming Leader. State: Replica: e00c6c7eeb7b42408df82dde9c8e672c, State: Running, Role: LEADER
I20260808 18:42:39.615235 30880 consensus_queue.cc:237] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } }
I20260808 18:42:39.615453 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:39.602735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51274 (local address 127.4.61.254:33515)
0808 18:42:39.603130 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:39.603148 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:39.603193 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:42:39.603821 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:39.603838 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:39.604149 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:39.604419 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:39.605279 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.606354 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.607425 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.607896 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.608011 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:39.610681 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:39.610686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:39.610699 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:39.610725 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:39.612384 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:39.612849 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:39.612856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:39.612862 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:39.613040 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:39.613310 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:39.613312 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:39.613313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:39.613689 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:39.613837 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:39.614143 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 18:42:39.614485 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":105,"threads_started":1}
I20260808 18:42:39.615661 30873 sys_catalog.cc:564] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:39.616422 30880 sys_catalog.cc:455] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e00c6c7eeb7b42408df82dde9c8e672c. Latest consensus state: current_term: 1 leader_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } } }
I20260808 18:42:39.617117 30880 sys_catalog.cc:458] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:39.617010 30881 sys_catalog.cc:455] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e00c6c7eeb7b42408df82dde9c8e672c" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33515 } } }
I20260808 18:42:39.617432 30881 sys_catalog.cc:458] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c [sys.catalog]: This master's current role is: LEADER
W20260808 18:42:39.620505 30909 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:42:39.620582 30909 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:42:39.620682 30900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:39.621496 30900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:39.627179 30900 catalog_manager.cc:1347] Generated new cluster ID: 209875b9ce1e48d3a036d2122dc637d0
I20260808 18:42:39.627231 30900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:39.639240 30900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:39.640106 30900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:39.654452 30900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: Generated new TSK 0
I20260808 18:42:39.655366 30900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:42:39.691458 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:39.805956 30917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:39.806229 30917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:39.806303 30917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:39.810472 30917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:39.810537 30917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:39.810595 30917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:39.815905 30917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:39.817039 30917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:39.818117 30917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:39.827587 30922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:39.827653 30932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:39.827652 30930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:39.827925 30917 server_base.cc:1034] running on GCE node
I20260808 18:42:39.828329 30917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:39.828925 30917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:39.830082 30917 hybrid_clock.cc:648] HybridClock initialized: now 1786214559830059 us; error 35 us; skew 500 ppm
Aug 08 18:42:39 dist-test-slave-fgb3 krb5kdc[30748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214559, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:39.832744 30917 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:42:39.833595 30917 webserver.cc:460] Webserver started at http://127.4.61.193:38485/ using document root <none> and password file <none>
I20260808 18:42:39.834136 30917 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:39.834205 30917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:39.834460 30917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:39.836524 30917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "d3210da2ed954d0b8580e99aa8dd95a8"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "efc9f732d1b86667b9b3a5e68a6d4db8"
server_key_iv: "053c19bbe5ce71fe21916ead03292f8f"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.837088 30917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "d3210da2ed954d0b8580e99aa8dd95a8"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "efc9f732d1b86667b9b3a5e68a6d4db8"
server_key_iv: "053c19bbe5ce71fe21916ead03292f8f"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.841224 30917 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:42:39.843811 30959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:39.845007 30917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:39.845131 30917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "d3210da2ed954d0b8580e99aa8dd95a8"
format_stamp: "Formatted at 2026-08-08 18:42:39 on dist-test-slave-fgb3"
server_key: "efc9f732d1b86667b9b3a5e68a6d4db8"
server_key_iv: "053c19bbe5ce71fe21916ead03292f8f"
server_key_version: "encryptionkey@0"
I20260808 18:42:39.845234 30917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:39.859510 30917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:39.862758 30917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:39.862946 30917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:39.863557 30917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:39.864418 30917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:39.864467 30917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:39.864524 30917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:39.864548 30917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:39.873153 30917 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:37681
I20260808 18:42:39.873183 31147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:37681 every 8 connection(s)
I20260808 18:42:39.874073 30917 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:39.878926 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 30917
I20260808 18:42:39.879055 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:39.879333 4343 external_mini_cluster.cc:1428] Setting key c5e3dd18fb924c4d93998fcca0476792
Aug 08 18:42:39 dist-test-slave-fgb3 krb5kdc[30748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214559, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:39.888094 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:39.876009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:59117 (local address 127.4.61.254:33515)
0808 18:42:39.876184 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:39.876188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:39.877045 (+ 857us) server_negotiation.cc:407] Connection header received
0808 18:42:39.878361 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:39.878364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:39.878434 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:39.878507 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:39.879795 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.880477 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.881616 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.881847 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.881934 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:39.884669 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:39.884672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:39.884674 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:39.884699 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:39.885966 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:39.886559 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:39.886562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:39.886563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:39.886634 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:39.887011 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:39.887014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:39.887015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:39.887193 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:39.887274 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:39.887866 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 18:42:39.887967 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":83}
I20260808 18:42:39.889299 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:39.876400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33515 (local address 127.4.61.193:59117)
0808 18:42:39.876875 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:39.876928 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:39.878125 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:39.878714 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:39.878721 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:39.879131 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:39.879650 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:39.879666 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.880602 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.880605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:39.881501 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:39.881511 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:39.881991 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:39.881995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:39.882166 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:39.882801 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:39.882822 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:39.884489 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:39.886079 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:39.886085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:39.886101 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:39.886470 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:39.886714 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:39.886717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:39.886719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:39.886899 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:39.887291 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:39.887298 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:39.887627 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 18:42:39.887848 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 18:42:39.888206 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:42:39.890534 31148 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33515
I20260808 18:42:39.890799 31148 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:39.891312 31148 heartbeater.cc:511] Master 127.4.61.254:33515 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:42:39.892961 30824 ts_manager.cc:194] Registered new tserver with Master: d3210da2ed954d0b8580e99aa8dd95a8 (127.4.61.193:37681)
I20260808 18:42:39.894126 30824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:59117
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:42:39.907279 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:40.019546 31159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:40.019810 31159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:40.019868 31159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:40.023911 31159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:40.023968 31159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:40.024029 31159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:40.029157 31159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:40.030336 31159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:40.031374 31159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:40.040697 31170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:40.040719 31169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:40.040697 31174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:40.040884 31159 server_base.cc:1034] running on GCE node
I20260808 18:42:40.041344 31159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:40.041944 31159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:40.043100 31159 hybrid_clock.cc:648] HybridClock initialized: now 1786214560043077 us; error 32 us; skew 500 ppm
Aug 08 18:42:40 dist-test-slave-fgb3 krb5kdc[30748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214560, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:40.045737 31159 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:42:40.046628 31159 webserver.cc:460] Webserver started at http://127.4.61.194:43271/ using document root <none> and password file <none>
I20260808 18:42:40.047163 31159 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:40.047230 31159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:40.047459 31159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:40.049528 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "66a09601d6be4956990893007f05c99c"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "688c8d9214edfa6bbacb7cbced5d7a69"
server_key_iv: "71061b9f85da6b7e36557a596119438a"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.050068 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "66a09601d6be4956990893007f05c99c"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "688c8d9214edfa6bbacb7cbced5d7a69"
server_key_iv: "71061b9f85da6b7e36557a596119438a"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.053665 31159 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:42:40.056034 31188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.057228 31159 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:40.057364 31159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "66a09601d6be4956990893007f05c99c"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "688c8d9214edfa6bbacb7cbced5d7a69"
server_key_iv: "71061b9f85da6b7e36557a596119438a"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.057472 31159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:40.081102 31159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:40.084507 31159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:40.084702 31159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:40.085332 31159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:40.086206 31159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:40.086256 31159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.086365 31159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:40.086398 31159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.095361 31159 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:42191
I20260808 18:42:40.095391 31381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:42191 every 8 connection(s)
I20260808 18:42:40.096312 31159 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:40.104795 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 31159
I20260808 18:42:40.104914 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:40.105238 4343 external_mini_cluster.cc:1428] Setting key 42a6a7b83ec7d04190e15696c7775043
Aug 08 18:42:40 dist-test-slave-fgb3 krb5kdc[30748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214560, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:40.109887 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.098283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:56683 (local address 127.4.61.254:33515)
0808 18:42:40.098497 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.098502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.099541 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 18:42:40.100398 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.100400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.100449 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.100526 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:40.101744 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.102283 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.103526 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.103766 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.103857 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.106428 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:40.106431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:40.106433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:40.106464 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:40.107846 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.108334 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.108337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.108339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.108417 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.108808 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.108811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.108812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.109051 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:40.109145 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.109596 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.109726 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 18:42:40.110816 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.098682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33515 (local address 127.4.61.194:56683)
0808 18:42:40.099384 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.099429 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.100222 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.100688 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.100694 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.101074 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:40.101575 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.101589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.102459 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.102462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.103380 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.103392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.103908 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.103911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.104070 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.104647 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:40.104664 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:40.106221 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:40.107961 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:40.107967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:40.107983 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:40.108240 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:40.108531 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:40.108535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:40.108537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:40.108722 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:40.109140 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:40.109144 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:40.109380 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.109534 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.109809 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":114,"threads_started":1}
I20260808 18:42:40.112017 31385 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33515
I20260808 18:42:40.112283 31385 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:40.112877 31385 heartbeater.cc:511] Master 127.4.61.254:33515 requested a full tablet report, sending...
I20260808 18:42:40.114038 30824 ts_manager.cc:194] Registered new tserver with Master: 66a09601d6be4956990893007f05c99c (127.4.61.194:42191)
I20260808 18:42:40.114645 30824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:56683
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:42:40.133419 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:40.248064 31394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:40.248344 31394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:40.248397 31394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:40.252547 31394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:40.252619 31394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:40.252682 31394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:40.258158 31394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:33515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:40.259585 31394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:40.260830 31394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:40.270679 31403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:40.270682 31407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:40.270800 31394 server_base.cc:1034] running on GCE node
W20260808 18:42:40.270743 31402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:40.271354 31394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:40.272010 31394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:40.273160 31394 hybrid_clock.cc:648] HybridClock initialized: now 1786214560273125 us; error 47 us; skew 500 ppm
Aug 08 18:42:40 dist-test-slave-fgb3 krb5kdc[30748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214560, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:40.275993 31394 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:42:40.276911 31394 webserver.cc:460] Webserver started at http://127.4.61.195:35431/ using document root <none> and password file <none>
I20260808 18:42:40.277472 31394 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:40.277536 31394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:40.277735 31394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:40.279861 31394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "3482c77ae8764d9e98585a7246743e81"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "13f1306db4641772b2afa200917653dd"
server_key_iv: "b682d4c9d8d2320f643632914ae3edf4"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.280402 31394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "3482c77ae8764d9e98585a7246743e81"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "13f1306db4641772b2afa200917653dd"
server_key_iv: "b682d4c9d8d2320f643632914ae3edf4"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.284344 31394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:42:40.286706 31414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.287978 31394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:40.288110 31394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "3482c77ae8764d9e98585a7246743e81"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "13f1306db4641772b2afa200917653dd"
server_key_iv: "b682d4c9d8d2320f643632914ae3edf4"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.288249 31394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:40.311888 31394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:40.315090 31394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:40.315272 31394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:40.315891 31394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:40.316772 31394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:40.316823 31394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.316861 31394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:40.316881 31394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.325469 31394 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:44011
I20260808 18:42:40.325506 31601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:44011 every 8 connection(s)
I20260808 18:42:40.326368 31394 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:40.330873 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 31394
I20260808 18:42:40.330996 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:40.331269 4343 external_mini_cluster.cc:1428] Setting key 39db1a479e4e3d589885882abb5c79f7
Aug 08 18:42:40 dist-test-slave-fgb3 krb5kdc[30748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214560, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:40.338909 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.328148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:50807 (local address 127.4.61.254:33515)
0808 18:42:40.328291 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.328295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.329105 (+ 810us) server_negotiation.cc:407] Connection header received
0808 18:42:40.330004 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.330008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.330068 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.330140 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:40.331429 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.332007 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.333159 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.333371 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.333466 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.335771 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:40.335774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:40.335776 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:40.335802 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:40.336962 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.337417 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.337420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.337421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.337505 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.337810 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.337813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.337815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.338006 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:40.338093 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.338626 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.338750 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:42:40.339661 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.328501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:33515 (local address 127.4.61.195:50807)
0808 18:42:40.328961 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.329002 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.329801 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.330369 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.330378 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.330747 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:40.331271 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.331286 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.332142 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.332146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.333042 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.333052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.333522 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.333526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.333695 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.334192 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:40.334208 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:40.335598 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:40.337065 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:40.337071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:40.337086 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:40.337323 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:40.337587 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:40.337590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:40.337592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:40.337722 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:40.338104 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:40.338111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:40.338397 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.338568 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.338881 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":117,"threads_started":1}
I20260808 18:42:40.340655 31602 heartbeater.cc:347] Connected to a master server at 127.4.61.254:33515
I20260808 18:42:40.340895 31602 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:40.341374 31602 heartbeater.cc:511] Master 127.4.61.254:33515 requested a full tablet report, sending...
I20260808 18:42:40.342414 30824 ts_manager.cc:194] Registered new tserver with Master: 3482c77ae8764d9e98585a7246743e81 (127.4.61.195:44011)
I20260808 18:42:40.342978 30824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:50807
I20260808 18:42:40.344785 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:40.353405 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.346686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.4.61.254:33515)
0808 18:42:40.346788 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.346792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.346995 (+ 203us) server_negotiation.cc:407] Connection header received
0808 18:42:40.347100 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.347103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.347141 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.347202 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:40.347864 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.348343 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.349212 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.349416 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.349508 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.350793 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:40.350796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:40.350798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:40.350820 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:40.351889 (+ 1069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.352266 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.352269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.352271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.352343 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:40.352581 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:40.352585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:40.352587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:40.352791 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:40.352907 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.353146 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.353259 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 18:42:40.356055 30824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:40.359011 30824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:40.373531 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.367308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37681 (local address 127.0.0.1:34944)
0808 18:42:40.367729 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.367776 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.367897 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.369168 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.369175 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.369199 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:40.369377 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.369383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370914 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.370917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.372120 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.372130 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.373219 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.373222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.373304 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373324 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.373377 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.373429 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":214,"thread_start_us":83,"threads_started":1}
I20260808 18:42:40.373664 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.367414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.4.61.193:37681)
0808 18:42:40.368663 (+ 1249us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.368680 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.368703 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:42:40.368796 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.368802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.368999 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.369152 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:40.369520 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370749 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.372233 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.373061 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.373215 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373357 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.373412 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.373506 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1141,"thread_start_us":99,"threads_started":1}
I20260808 18:42:40.373802 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.367672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42191 (local address 127.0.0.1:43412)
0808 18:42:40.368044 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.368057 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.368145 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.369230 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.369233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.369246 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:40.369375 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.369383 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370896 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.370899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.372281 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.372289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.373422 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.373425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.373522 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373544 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.373613 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.373679 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":48,"thread_start_us":90,"threads_started":1}
I20260808 18:42:40.374182 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.368092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43412 (local address 127.4.61.194:42191)
0808 18:42:40.368602 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.368614 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.368636 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:42:40.368701 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.368705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.368906 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.369056 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:40.369520 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370749 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.372384 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.373153 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.373236 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373357 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.373952 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.374051 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":99,"threads_started":1}
I20260808 18:42:40.374207 31625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.368260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45906 (local address 127.4.61.195:44011)
0808 18:42:40.368938 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.368949 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.368968 (+ 19us) server_negotiation.cc:407] Connection header received
0808 18:42:40.369046 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.369053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.369214 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.369396 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:40.369616 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370439 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.372283 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.372863 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.372961 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373117 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.374007 (+ 890us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.374099 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":148,"threads_started":1}
I20260808 18:42:40.373530 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.368038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:44011 (local address 127.0.0.1:45906)
0808 18:42:40.368317 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.368329 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.368419 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.369396 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.369399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.369423 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:40.369515 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.369521 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.370555 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.370558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.372144 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.372156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.372982 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.372986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.373089 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.373126 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.373241 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.373361 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":299,"thread_start_us":89,"threads_started":1}
I20260808 18:42:40.376922 31494 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4108824a949d8889e33dd741f08b8 (DEFAULT_TABLE table=test-table [id=0aad5fc739ba4b5aa6d962b8fe5857b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:40.376878 31046 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4108824a949d8889e33dd741f08b8 (DEFAULT_TABLE table=test-table [id=0aad5fc739ba4b5aa6d962b8fe5857b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:40.377866 31494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4108824a949d8889e33dd741f08b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:40.377954 31046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4108824a949d8889e33dd741f08b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:40.377748 31257 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4108824a949d8889e33dd741f08b8 (DEFAULT_TABLE table=test-table [id=0aad5fc739ba4b5aa6d962b8fe5857b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:40.378685 31257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4108824a949d8889e33dd741f08b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:40.383899 31627 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Bootstrap starting.
I20260808 18:42:40.385403 31628 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: Bootstrap starting.
I20260808 18:42:40.385686 31629 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Bootstrap starting.
I20260808 18:42:40.386191 31627 tablet_bootstrap.cc:654] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:40.387410 31628 tablet_bootstrap.cc:654] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:40.387689 31627 log.cc:824] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:40.388186 31629 tablet_bootstrap.cc:654] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:40.388464 31628 log.cc:824] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:40.388960 31629 log.cc:824] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:40.389777 31627 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: No bootstrap required, opened a new log
I20260808 18:42:40.389974 31627 ts_tablet_manager.cc:1397] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:42:40.390161 31628 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: No bootstrap required, opened a new log
I20260808 18:42:40.390364 31628 ts_tablet_manager.cc:1397] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:42:40.391064 31629 tablet_bootstrap.cc:492] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: No bootstrap required, opened a new log
I20260808 18:42:40.391232 31629 ts_tablet_manager.cc:1397] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:42:40.393573 31628 raft_consensus.cc:348] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.393795 31628 raft_consensus.cc:374] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:40.393877 31628 raft_consensus.cc:729] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3210da2ed954d0b8580e99aa8dd95a8, State: Initialized, Role: FOLLOWER
I20260808 18:42:40.393869 31627 raft_consensus.cc:348] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.394213 31627 raft_consensus.cc:374] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:40.394287 31627 raft_consensus.cc:729] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3482c77ae8764d9e98585a7246743e81, State: Initialized, Role: FOLLOWER
I20260808 18:42:40.394767 31627 consensus_queue.cc:260] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.394851 31629 raft_consensus.cc:348] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.395112 31629 raft_consensus.cc:374] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:40.395160 31629 raft_consensus.cc:729] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a09601d6be4956990893007f05c99c, State: Initialized, Role: FOLLOWER
I20260808 18:42:40.395493 31629 consensus_queue.cc:260] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.396432 31628 consensus_queue.cc:260] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.396890 31385 heartbeater.cc:503] Master 127.4.61.254:33515 was elected leader, sending a full tablet report...
I20260808 18:42:40.397274 31629 ts_tablet_manager.cc:1428] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:42:40.397428 31628 ts_tablet_manager.cc:1428] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260808 18:42:40.397718 31148 heartbeater.cc:503] Master 127.4.61.254:33515 was elected leader, sending a full tablet report...
I20260808 18:42:40.397708 31602 heartbeater.cc:503] Master 127.4.61.254:33515 was elected leader, sending a full tablet report...
I20260808 18:42:40.398546 31627 ts_tablet_manager.cc:1428] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260808 18:42:40.493094 31640 raft_consensus.cc:482] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:40.493294 31640 raft_consensus.cc:504] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.494503 31640 leader_election.cc:288] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3482c77ae8764d9e98585a7246743e81 (127.4.61.195:44011), 66a09601d6be4956990893007f05c99c (127.4.61.194:42191)
I20260808 18:42:40.498662 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.494870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:53615 (local address 127.4.61.194:42191)
0808 18:42:40.495069 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.495074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.495300 (+ 226us) server_negotiation.cc:407] Connection header received
0808 18:42:40.495439 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.495443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.495497 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.495565 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:40.495871 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.496394 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.497671 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.498074 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.498171 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.498229 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.498448 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.498525 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 18:42:40.498677 31625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.494900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51251 (local address 127.4.61.195:44011)
0808 18:42:40.495044 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.495049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.495431 (+ 382us) server_negotiation.cc:407] Connection header received
0808 18:42:40.495561 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.495565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.495616 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.495687 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:40.495972 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.496497 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.497677 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.498108 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.498222 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.498275 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.498501 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.498574 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:42:40.498692 31641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.494765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:44011 (local address 127.4.61.193:51251)
0808 18:42:40.495331 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.495344 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.495453 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.495710 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.495713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.495727 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:40.495842 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.495848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.496612 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.496616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.497555 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.497565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.498231 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.498235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.498373 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.498397 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.498473 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.498538 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":76,"thread_start_us":128,"threads_started":1}
I20260808 18:42:40.498706 31643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.494765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42191 (local address 127.4.61.193:53615)
0808 18:42:40.495204 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.495216 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:40.495331 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:40.495594 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:40.495597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:40.495613 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:40.495760 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.495768 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.496507 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.496511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.497543 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:40.497554 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.498201 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.498205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:40.498295 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.498350 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 18:42:40.498419 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:42:40.498490 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":35,"thread_start_us":146,"threads_started":1}
I20260808 18:42:40.499357 31294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd4108824a949d8889e33dd741f08b8" candidate_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a09601d6be4956990893007f05c99c" is_pre_election: true
I20260808 18:42:40.499348 31526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd4108824a949d8889e33dd741f08b8" candidate_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3482c77ae8764d9e98585a7246743e81" is_pre_election: true
I20260808 18:42:40.499650 31526 raft_consensus.cc:2454] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3210da2ed954d0b8580e99aa8dd95a8 in term 0.
I20260808 18:42:40.499652 31294 raft_consensus.cc:2454] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3210da2ed954d0b8580e99aa8dd95a8 in term 0.
I20260808 18:42:40.500106 30966 leader_election.cc:302] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3482c77ae8764d9e98585a7246743e81, d3210da2ed954d0b8580e99aa8dd95a8; no voters:
I20260808 18:42:40.500370 31640 raft_consensus.cc:2781] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:40.500463 31640 raft_consensus.cc:482] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:40.500511 31640 raft_consensus.cc:3037] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:40.501546 31640 raft_consensus.cc:504] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.501879 31640 leader_election.cc:288] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [CANDIDATE]: Term 1 election: Requested vote from peers 3482c77ae8764d9e98585a7246743e81 (127.4.61.195:44011), 66a09601d6be4956990893007f05c99c (127.4.61.194:42191)
I20260808 18:42:40.502229 31294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd4108824a949d8889e33dd741f08b8" candidate_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a09601d6be4956990893007f05c99c"
I20260808 18:42:40.502236 31526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd4108824a949d8889e33dd741f08b8" candidate_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3482c77ae8764d9e98585a7246743e81"
I20260808 18:42:40.502370 31294 raft_consensus.cc:3037] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:40.502369 31526 raft_consensus.cc:3037] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:40.503363 31526 raft_consensus.cc:2454] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3210da2ed954d0b8580e99aa8dd95a8 in term 1.
I20260808 18:42:40.503396 31294 raft_consensus.cc:2454] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3210da2ed954d0b8580e99aa8dd95a8 in term 1.
I20260808 18:42:40.503664 30966 leader_election.cc:302] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3482c77ae8764d9e98585a7246743e81, d3210da2ed954d0b8580e99aa8dd95a8; no voters:
I20260808 18:42:40.503841 31640 raft_consensus.cc:2781] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:40.504063 31640 raft_consensus.cc:686] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 1 LEADER]: Becoming Leader. State: Replica: d3210da2ed954d0b8580e99aa8dd95a8, State: Running, Role: LEADER
I20260808 18:42:40.504428 31640 consensus_queue.cc:237] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } }
I20260808 18:42:40.507548 30824 catalog_manager.cc:5495] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3210da2ed954d0b8580e99aa8dd95a8 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3210da2ed954d0b8580e99aa8dd95a8" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 } health_report { overall_health: UNKNOWN } } }
I20260808 18:42:40.527204 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.523666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.4.61.193:37681)
0808 18:42:40.523804 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.523809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.523822 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:42:40.523915 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.523917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.523977 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.524073 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:40.524330 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.524836 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.525692 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.525911 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.526001 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.526344 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:40.526812 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:40.526924 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.526997 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.527062 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:42:40.533133 31294 raft_consensus.cc:1261] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 1 FOLLOWER]: Refusing update from remote peer d3210da2ed954d0b8580e99aa8dd95a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:40.533133 31526 raft_consensus.cc:1261] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 1 FOLLOWER]: Refusing update from remote peer d3210da2ed954d0b8580e99aa8dd95a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:40.533792 31640 consensus_queue.cc:1035] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3482c77ae8764d9e98585a7246743e81" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:40.533993 31644 consensus_queue.cc:1035] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a09601d6be4956990893007f05c99c" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:40.550185 30823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:40.550408 30823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:40.552824 30823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e00c6c7eeb7b42408df82dde9c8e672c: Sending DeleteTablet for 3 replicas of tablet 4cd4108824a949d8889e33dd741f08b8
I20260808 18:42:40.553648 31046 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4108824a949d8889e33dd741f08b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:40 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:34944
I20260808 18:42:40.553680 31257 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4108824a949d8889e33dd741f08b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:40 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43412
I20260808 18:42:40.553805 31494 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4108824a949d8889e33dd741f08b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:40 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:45906
I20260808 18:42:40.554268 31662 tablet_replica.cc:330] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: stopping tablet replica
I20260808 18:42:40.554515 31661 tablet_replica.cc:330] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8: stopping tablet replica
I20260808 18:42:40.554778 31661 raft_consensus.cc:2229] T 4cd4108824a949d8889e33dd741f08b8 P d3210da2ed954d0b8580e99aa8dd95a8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:40.555078 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 30917
I20260808 18:42:40.562007 31662 raft_consensus.cc:2229] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:40.562402 31662 raft_consensus.cc:2258] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:40.562796 31660 tablet_replica.cc:330] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: stopping tablet replica
I20260808 18:42:40.563112 31660 raft_consensus.cc:2229] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:40.563421 31660 raft_consensus.cc:2258] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:40.564172 31662 ts_tablet_manager.cc:1905] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:40.566373 31660 ts_tablet_manager.cc:1905] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:40.566764 31662 ts_tablet_manager.cc:1918] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:40.566849 31662 log.cc:1196] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/4cd4108824a949d8889e33dd741f08b8
I20260808 18:42:40.567138 31662 ts_tablet_manager.cc:1939] T 4cd4108824a949d8889e33dd741f08b8 P 3482c77ae8764d9e98585a7246743e81: Deleting consensus metadata
I20260808 18:42:40.568331 30798 catalog_manager.cc:4841] TS 3482c77ae8764d9e98585a7246743e81 (127.4.61.195:44011): tablet 4cd4108824a949d8889e33dd741f08b8 (table test-table [id=0aad5fc739ba4b5aa6d962b8fe5857b6]) successfully deleted
I20260808 18:42:40.572506 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 31159
W20260808 18:42:40.572481 30798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:37681 (error 108)
I20260808 18:42:40.572680 31660 ts_tablet_manager.cc:1918] T 4cd4108824a949d8889e33dd741f08b8 P 66a09601d6be4956990893007f05c99c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:40.579371 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.579010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37681 (local address 127.0.0.1:34954)
0808 18:42:40.579227 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.579286 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260808 18:42:40.581303 30798 catalog_manager.cc:4584] TS d3210da2ed954d0b8580e99aa8dd95a8 (127.4.61.193:37681): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4cd4108824a949d8889e33dd741f08b8: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37681: connect: Connection refused (error 111)
I20260808 18:42:40.587844 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 31394
I20260808 18:42:40.592384 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.588012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42191 (local address 127.0.0.1:43426)
0808 18:42:40.592205 (+ 4193us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:40.592276 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.194:42191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4096}
I20260808 18:42:40.598471 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 30766
2026-08-08T18:42:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2458 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T18:42:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:40Z Disabled control of system clock
I20260808 18:42:40.637843 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36085
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:36085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:40.752117 31671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:40.752390 31671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:40.752424 31671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:40.756382 31671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:40.756440 31671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:40.756454 31671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:40.756469 31671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:40.756482 31671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:40.761147 31671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:36085
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:36085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:40.762270 31671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:40.763761 31671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:40.772243 31680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:40.772341 31684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:40.772387 31671 server_base.cc:1034] running on GCE node
W20260808 18:42:40.772290 31681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:40.773070 31671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:40.774209 31671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:40.775364 31671 hybrid_clock.cc:648] HybridClock initialized: now 1786214560775351 us; error 26 us; skew 500 ppm
I20260808 18:42:40.777194 31671 webserver.cc:460] Webserver started at http://127.4.61.254:38785/ using document root <none> and password file <none>
I20260808 18:42:40.777752 31671 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:40.777819 31671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:40.778053 31671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:40.780102 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "6e99179f440842779b74df1ed4e87a36"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "7f27b78242e888edfb53bea069dd6f95"
server_key_iv: "c8c4ca7e8cdb0e584e699b4a123b4dc7"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.780645 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "6e99179f440842779b74df1ed4e87a36"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "7f27b78242e888edfb53bea069dd6f95"
server_key_iv: "c8c4ca7e8cdb0e584e699b4a123b4dc7"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.784366 31671 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:42:40.786827 31692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:40.788224 31671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:40.788388 31671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "6e99179f440842779b74df1ed4e87a36"
format_stamp: "Formatted at 2026-08-08 18:42:40 on dist-test-slave-fgb3"
server_key: "7f27b78242e888edfb53bea069dd6f95"
server_key_iv: "c8c4ca7e8cdb0e584e699b4a123b4dc7"
server_key_version: "encryptionkey@0"
I20260808 18:42:40.788499 31671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:40.804967 31671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:40.805689 31671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:40.805873 31671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:40.812757 31671 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:36085
I20260808 18:42:40.812769 31782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:36085 every 8 connection(s)
I20260808 18:42:40.813697 31671 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:40.816809 31783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:40.822300 31783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: Bootstrap starting.
I20260808 18:42:40.823889 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 31671
I20260808 18:42:40.824005 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:40.824267 4343 external_mini_cluster.cc:1428] Setting key 550d9da868c2a2c7d179948a43f745bf
I20260808 18:42:40.824859 31783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:40.825691 31783 log.cc:824] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:40.827800 31783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: No bootstrap required, opened a new log
I20260808 18:42:40.831881 31783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } }
I20260808 18:42:40.832104 31783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:40.832168 31783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e99179f440842779b74df1ed4e87a36, State: Initialized, Role: FOLLOWER
I20260808 18:42:40.832696 31783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } }
I20260808 18:42:40.832854 31783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:40.832926 31783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:40.833029 31783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:40.833392 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:40.825375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39884 (local address 127.4.61.254:36085)
0808 18:42:40.826027 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:40.826047 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:40.826092 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:42:40.826864 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:40.826884 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:40.827206 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:40.827483 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:40.827861 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.828890 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.830138 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:40.830654 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:40.830768 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:40.831643 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:40.831648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:40.831660 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:40.832032 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:40.832087 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:40.832106 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:40.832198 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:40.832357 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 18:42:40.832592 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":121,"threads_started":1}
I20260808 18:42:40.833916 31783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } }
I20260808 18:42:40.834242 31783 leader_election.cc:302] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e99179f440842779b74df1ed4e87a36; no voters:
I20260808 18:42:40.834594 31783 leader_election.cc:288] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:40.834672 31791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:40.834899 31791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [term 1 LEADER]: Becoming Leader. State: Replica: 6e99179f440842779b74df1ed4e87a36, State: Running, Role: LEADER
I20260808 18:42:40.835256 31791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } }
I20260808 18:42:40.835884 31783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:40.836982 31794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e99179f440842779b74df1ed4e87a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } } }
I20260808 18:42:40.837018 31792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e99179f440842779b74df1ed4e87a36. Latest consensus state: current_term: 1 leader_uuid: "6e99179f440842779b74df1ed4e87a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e99179f440842779b74df1ed4e87a36" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 36085 } } }
I20260808 18:42:40.837204 31794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:40.837219 31792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:40.838040 31808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:40.841156 31808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:40.846745 31808 catalog_manager.cc:1347] Generated new cluster ID: b108ee13bd55412aa5e28e2ca7bcec83
I20260808 18:42:40.846819 31808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:40.887332 31808 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:40.888616 31808 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:40.905297 31808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: Generated new TSK 0
I20260808 18:42:40.906091 31808 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:40.911069 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--builtin_ntp_servers=127.4.61.212:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:41.025731 31819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:41.026010 31819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:41.026049 31819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:41.030088 31819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:41.030145 31819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:41.030200 31819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:41.034924 31819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:41.036156 31819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:41.037701 31819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:41.047581 31825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:41.047581 31826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:41.047663 31819 server_base.cc:1034] running on GCE node
W20260808 18:42:41.047585 31834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:41.048274 31819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:41.048916 31819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:41.050096 31819 hybrid_clock.cc:648] HybridClock initialized: now 1786214561050067 us; error 40 us; skew 500 ppm
I20260808 18:42:41.052000 31819 webserver.cc:460] Webserver started at http://127.4.61.193:37301/ using document root <none> and password file <none>
I20260808 18:42:41.052565 31819 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:41.052628 31819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:41.052793 31819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:41.054899 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "5368eff2926745929d43eff686b6b90c"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "cc177e73229befa608aed43d74c39e2a"
server_key_iv: "683df031a25a2af0c50c8e0afe4c10c1"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.055420 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "5368eff2926745929d43eff686b6b90c"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "cc177e73229befa608aed43d74c39e2a"
server_key_iv: "683df031a25a2af0c50c8e0afe4c10c1"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.059221 31819 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:42:41.061690 31840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.062973 31819 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:42:41.063076 31819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "5368eff2926745929d43eff686b6b90c"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "cc177e73229befa608aed43d74c39e2a"
server_key_iv: "683df031a25a2af0c50c8e0afe4c10c1"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.063165 31819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:41.095978 31819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:41.096709 31819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:41.096872 31819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:41.097455 31819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:41.098541 31819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:41.098606 31819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.098654 31819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:41.098675 31819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.107018 31819 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:37003
I20260808 18:42:41.107048 32033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:37003 every 8 connection(s)
I20260808 18:42:41.107906 31819 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:41.108877 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 31819
I20260808 18:42:41.108984 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:41.109251 4343 external_mini_cluster.cc:1428] Setting key e63d545908b1c58c2284fe175ee9b400
I20260808 18:42:41.111410 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--builtin_ntp_servers=127.4.61.212:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:41.117479 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.109918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:38027 (local address 127.4.61.254:36085)
0808 18:42:41.110072 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.110075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.111234 (+ 1159us) server_negotiation.cc:407] Connection header received
0808 18:42:41.112647 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.112650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.112703 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.112785 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:41.113966 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.114538 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.115686 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.115908 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.115999 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.117021 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:41.117024 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:41.117026 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:41.117038 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:41.117056 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:41.117063 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:41.117121 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.117267 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.117337 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:42:41.118325 32037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.110340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36085 (local address 127.4.61.193:38027)
0808 18:42:41.111080 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.111133 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.112442 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.113015 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.113024 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.113132 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:41.113814 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.113834 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.114647 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.114649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.115559 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.115570 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.116057 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.116061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.116215 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.116764 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:41.116765 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:41.116812 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:41.116875 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:41.117133 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:41.117142 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:41.117148 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.117253 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.117523 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":115,"threads_started":1}
I20260808 18:42:41.119459 32035 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36085
I20260808 18:42:41.119680 32035 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:41.120175 32035 heartbeater.cc:511] Master 127.4.61.254:36085 requested a full tablet report, sending...
I20260808 18:42:41.121829 31722 ts_manager.cc:194] Registered new tserver with Master: 5368eff2926745929d43eff686b6b90c (127.4.61.193:37003)
I20260808 18:42:41.123507 31722 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.193:38027
W20260808 18:42:41.224871 32043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:41.225157 32043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:41.225196 32043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:41.229269 32043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:41.229331 32043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:41.229386 32043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:41.234063 32043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:41.235152 32043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:41.236531 32043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:41.245970 32053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:41.246006 32049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:41.246018 32048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:41.246331 32043 server_base.cc:1034] running on GCE node
I20260808 18:42:41.246713 32043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:41.247313 32043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:41.248478 32043 hybrid_clock.cc:648] HybridClock initialized: now 1786214561248448 us; error 41 us; skew 500 ppm
I20260808 18:42:41.250236 32043 webserver.cc:460] Webserver started at http://127.4.61.194:46645/ using document root <none> and password file <none>
I20260808 18:42:41.250828 32043 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:41.250898 32043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:41.251086 32043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:41.253111 32043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "6bda9674cf14455a9d7c7b38245eb5cb"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "2a7aebc8fed50c20341d2929a19f6904"
server_key_iv: "327c5188e8e7a7d36ee25ddba9d12f80"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.253641 32043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "6bda9674cf14455a9d7c7b38245eb5cb"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "2a7aebc8fed50c20341d2929a19f6904"
server_key_iv: "327c5188e8e7a7d36ee25ddba9d12f80"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.257177 32043 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:42:41.259682 32066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.260943 32043 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:41.261062 32043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "6bda9674cf14455a9d7c7b38245eb5cb"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "2a7aebc8fed50c20341d2929a19f6904"
server_key_iv: "327c5188e8e7a7d36ee25ddba9d12f80"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.261168 32043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:41.281615 32043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:41.282295 32043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:41.282558 32043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:41.283165 32043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:41.284094 32043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:41.284144 32043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.284183 32043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:41.284204 32043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.292775 32043 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:46881
I20260808 18:42:41.292799 32240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:46881 every 8 connection(s)
I20260808 18:42:41.293774 32043 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:41.298938 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 32043
I20260808 18:42:41.299062 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:41.299325 4343 external_mini_cluster.cc:1428] Setting key 0050c1e2d4ff260a1e3703038bb5432e
I20260808 18:42:41.301355 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--builtin_ntp_servers=127.4.61.212:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:41.303361 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.295679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:37689 (local address 127.4.61.254:36085)
0808 18:42:41.295871 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.295875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.296896 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 18:42:41.298404 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.298407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.298458 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.298534 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:41.299524 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.300176 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.301426 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.301703 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.301802 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.302879 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:41.302883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:41.302886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:41.302900 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:41.302922 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:41.302932 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:41.303008 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.303192 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.303243 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 18:42:41.304472 32243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.296057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36085 (local address 127.4.61.194:37689)
0808 18:42:41.296761 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.296803 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.298170 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.298693 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.298700 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.298796 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:41.299367 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.299383 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.300307 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.300310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.301300 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.301310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.301846 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.301849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.301992 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.302619 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:41.302621 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:41.302660 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:41.302732 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:41.303039 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:41.303049 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:41.303056 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.303187 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.303480 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":127,"threads_started":1}
I20260808 18:42:41.305576 32241 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36085
I20260808 18:42:41.305821 32241 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:41.306496 32241 heartbeater.cc:511] Master 127.4.61.254:36085 requested a full tablet report, sending...
I20260808 18:42:41.307597 31722 ts_manager.cc:194] Registered new tserver with Master: 6bda9674cf14455a9d7c7b38245eb5cb (127.4.61.194:46881)
I20260808 18:42:41.308212 31722 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.194:37689
W20260808 18:42:41.416435 32244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:41.416715 32244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:41.416754 32244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:41.420814 32244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:41.420888 32244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:41.420944 32244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:41.425724 32244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:36085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:41.426878 32244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:41.428360 32244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:41.438019 32253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:41.438040 32244 server_base.cc:1034] running on GCE node
W20260808 18:42:41.437935 32249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:41.437952 32256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:41.438674 32244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:41.439258 32244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:41.440410 32244 hybrid_clock.cc:648] HybridClock initialized: now 1786214561440383 us; error 39 us; skew 500 ppm
I20260808 18:42:41.442303 32244 webserver.cc:460] Webserver started at http://127.4.61.195:35637/ using document root <none> and password file <none>
I20260808 18:42:41.442979 32244 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:41.443044 32244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:41.443208 32244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:41.445257 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "564a432df78e4c6aacf77e57e9db92e9"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "3080509ba1c4375c45d09461744c7f90"
server_key_iv: "3e56bc65b33222cde80dc572bd50b67a"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.445796 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "564a432df78e4c6aacf77e57e9db92e9"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "3080509ba1c4375c45d09461744c7f90"
server_key_iv: "3e56bc65b33222cde80dc572bd50b67a"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.449520 32244 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:42:41.451977 32266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.453190 32244 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:41.453303 32244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "564a432df78e4c6aacf77e57e9db92e9"
format_stamp: "Formatted at 2026-08-08 18:42:41 on dist-test-slave-fgb3"
server_key: "3080509ba1c4375c45d09461744c7f90"
server_key_iv: "3e56bc65b33222cde80dc572bd50b67a"
server_key_version: "encryptionkey@0"
I20260808 18:42:41.453414 32244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:41.492501 32244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:41.493256 32244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:41.493449 32244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:41.494073 32244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:41.495131 32244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:41.495182 32244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.495239 32244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:41.495265 32244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:41.504307 32244 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:34975
I20260808 18:42:41.504338 32453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:34975 every 8 connection(s)
I20260808 18:42:41.505283 32244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:41.509261 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 32244
I20260808 18:42:41.509358 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:41.509730 4343 external_mini_cluster.cc:1428] Setting key 1aaa7ab18bee1d766ffabe4b5e6655ba
I20260808 18:42:41.514986 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.507278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:33955 (local address 127.4.61.254:36085)
0808 18:42:41.507458 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.507462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.508650 (+ 1188us) server_negotiation.cc:407] Connection header received
0808 18:42:41.510154 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.510158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.510213 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.510340 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:41.511587 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.512191 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.513350 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.513564 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.513628 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.514612 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:41.514615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:41.514617 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:41.514630 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:41.514649 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:41.514657 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:41.514711 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.514818 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.514869 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 18:42:41.515980 32456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.507744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:36085 (local address 127.4.61.195:33955)
0808 18:42:41.508482 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.508524 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.509918 (+ 1394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.510583 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.510593 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.510710 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:41.511425 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.511447 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.512328 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.512331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.513245 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.513262 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.513666 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.513668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.513820 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.514372 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:41.514374 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:41.514414 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:41.514480 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:41.514717 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:41.514722 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:41.514726 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.514816 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.515043 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":131,"threads_started":1}
I20260808 18:42:41.517171 32454 heartbeater.cc:347] Connected to a master server at 127.4.61.254:36085
I20260808 18:42:41.517410 32454 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:41.517906 32454 heartbeater.cc:511] Master 127.4.61.254:36085 requested a full tablet report, sending...
I20260808 18:42:41.518925 31722 ts_manager.cc:194] Registered new tserver with Master: 564a432df78e4c6aacf77e57e9db92e9 (127.4.61.195:34975)
I20260808 18:42:41.519469 31722 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.195:33955
I20260808 18:42:41.523859 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:41.529572 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.525884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39896 (local address 127.4.61.254:36085)
0808 18:42:41.526041 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.526045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.526165 (+ 120us) server_negotiation.cc:407] Connection header received
0808 18:42:41.526363 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.526366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.526415 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.526477 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:41.526777 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.527293 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.528130 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.528356 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.528441 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.529143 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:41.529146 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:41.529149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:41.529162 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:41.529182 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:41.529190 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:41.529246 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.529371 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.529430 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 18:42:41.532332 31722 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:41.535272 31722 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:41.549623 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.544274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:34975 (local address 127.0.0.1:45656)
0808 18:42:41.544898 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.544911 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.545000 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.545704 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.545706 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.545720 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:41.545782 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.545788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.546907 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.546910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.548241 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.548251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.549165 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.549167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.549245 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.549278 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.549355 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.549459 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":72,"thread_start_us":96,"threads_started":1}
I20260808 18:42:41.549721 32476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.544799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45656 (local address 127.4.61.195:34975)
0808 18:42:41.545245 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.545258 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.545280 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:42:41.545350 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.545355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.545567 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.545912 (+ 345us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:41.546021 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.546802 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.548358 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.549060 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.549168 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.549372 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.549440 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.549544 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":116,"threads_started":1}
I20260808 18:42:41.549955 32472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.543756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55862 (local address 127.4.61.193:37003)
0808 18:42:41.545151 (+ 1395us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.545165 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.545193 (+ 28us) server_negotiation.cc:407] Connection header received
0808 18:42:41.545270 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.545275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.545457 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.545655 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:41.545852 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.546966 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.548616 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.549375 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.549487 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.549659 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.549709 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.549796 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":105,"threads_started":1}
I20260808 18:42:41.549860 32469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.543562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37003 (local address 127.0.0.1:55862)
0808 18:42:41.543925 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.543980 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.544114 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.545623 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.545626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.545643 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:41.545745 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.545751 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.547070 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.547073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.548486 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.548498 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.549498 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.549502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.549595 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.549618 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.549675 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.549740 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":55,"thread_start_us":69,"threads_started":1}
I20260808 18:42:41.551669 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.543884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:46881 (local address 127.0.0.1:56778)
0808 18:42:41.544361 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.544373 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.544471 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.545258 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.545264 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.545291 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:41.545450 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.545458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.546981 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.546984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.548487 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.548498 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.551296 (+ 2798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.551299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.551385 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.551407 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.551468 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.551536 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":160,"thread_start_us":117,"threads_started":1}
I20260808 18:42:41.551769 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.544271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56778 (local address 127.4.61.194:46881)
0808 18:42:41.544723 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.544736 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.544761 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:42:41.544842 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.544848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.545080 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.545253 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:41.545579 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.546823 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.549968 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.551194 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.551296 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.551488 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.551536 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.551623 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":160,"threads_started":1}
I20260808 18:42:41.553351 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 (DEFAULT_TABLE table=test-table [id=78544d6f645e478c914bc5f034b2d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:41.553351 31927 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 (DEFAULT_TABLE table=test-table [id=78544d6f645e478c914bc5f034b2d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:41.554577 31927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffa0b79ce2c4c909831979815bcd512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:41.554576 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffa0b79ce2c4c909831979815bcd512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:41.554174 32142 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 (DEFAULT_TABLE table=test-table [id=78544d6f645e478c914bc5f034b2d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:41.555209 32142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffa0b79ce2c4c909831979815bcd512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:41.561540 32477 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Bootstrap starting.
I20260808 18:42:41.562652 32481 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Bootstrap starting.
I20260808 18:42:41.563643 32477 tablet_bootstrap.cc:654] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:41.564415 32481 tablet_bootstrap.cc:654] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:41.564409 32477 log.cc:824] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:41.565080 32478 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Bootstrap starting.
I20260808 18:42:41.565168 32481 log.cc:824] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:41.566675 32477 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: No bootstrap required, opened a new log
I20260808 18:42:41.566875 32477 ts_tablet_manager.cc:1397] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:42:41.567127 32481 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: No bootstrap required, opened a new log
I20260808 18:42:41.567303 32481 ts_tablet_manager.cc:1397] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:42:41.567294 32478 tablet_bootstrap.cc:654] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:41.568061 32478 log.cc:824] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:41.569978 32478 tablet_bootstrap.cc:492] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: No bootstrap required, opened a new log
I20260808 18:42:41.570154 32478 ts_tablet_manager.cc:1397] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:42:41.570860 32481 raft_consensus.cc:348] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.571085 32481 raft_consensus.cc:374] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:41.571156 32481 raft_consensus.cc:729] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564a432df78e4c6aacf77e57e9db92e9, State: Initialized, Role: FOLLOWER
I20260808 18:42:41.571089 32477 raft_consensus.cc:348] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.571347 32477 raft_consensus.cc:374] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:41.571434 32477 raft_consensus.cc:729] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bda9674cf14455a9d7c7b38245eb5cb, State: Initialized, Role: FOLLOWER
I20260808 18:42:41.571617 32481 consensus_queue.cc:260] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.571837 32477 consensus_queue.cc:260] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.572681 32481 ts_tablet_manager.cc:1428] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:42:41.572772 32477 ts_tablet_manager.cc:1428] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:42:41.573068 32454 heartbeater.cc:503] Master 127.4.61.254:36085 was elected leader, sending a full tablet report...
I20260808 18:42:41.573163 32241 heartbeater.cc:503] Master 127.4.61.254:36085 was elected leader, sending a full tablet report...
I20260808 18:42:41.573989 32478 raft_consensus.cc:348] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.574246 32478 raft_consensus.cc:374] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:41.574307 32478 raft_consensus.cc:729] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5368eff2926745929d43eff686b6b90c, State: Initialized, Role: FOLLOWER
I20260808 18:42:41.574694 32478 consensus_queue.cc:260] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.575325 32035 heartbeater.cc:503] Master 127.4.61.254:36085 was elected leader, sending a full tablet report...
I20260808 18:42:41.575444 32478 ts_tablet_manager.cc:1428] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260808 18:42:41.609050 32036 tablet.cc:2369] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:42:41.756271 32455 tablet.cc:2369] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:41.785362 32486 raft_consensus.cc:482] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:41.785591 32486 raft_consensus.cc:504] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.786775 32486 leader_election.cc:288] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5368eff2926745929d43eff686b6b90c (127.4.61.193:37003), 6bda9674cf14455a9d7c7b38245eb5cb (127.4.61.194:46881)
I20260808 18:42:41.790536 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.787313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:47175 (local address 127.4.61.194:46881)
0808 18:42:41.787450 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.787453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.787632 (+ 179us) server_negotiation.cc:407] Connection header received
0808 18:42:41.787751 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.787754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.787807 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.787881 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:41.788146 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.788676 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.789650 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.790030 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.790136 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.790185 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.790360 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.790435 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:42:41.790534 32472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.787148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:52627 (local address 127.4.61.193:37003)
0808 18:42:41.787300 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.787305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.787322 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:42:41.787381 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.787384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.787448 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.787525 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:41.787873 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.788493 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.789587 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.789996 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.790087 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.790138 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.790339 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.790403 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 18:42:41.790536 32456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.787037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37003 (local address 127.4.61.195:52627)
0808 18:42:41.787152 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.787167 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.787269 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.787573 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.787575 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.787598 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:41.787749 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.787756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.788594 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.788598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.789461 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.789471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.790103 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.790107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.790199 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.790223 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.790282 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.790384 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":3,"spinlock_wait_cycles":29056}
I20260808 18:42:41.790547 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.787037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:46881 (local address 127.4.61.195:47175)
0808 18:42:41.787542 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.787556 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:41.787658 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:41.787894 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:41.787897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:41.787914 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:41.788046 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.788052 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.788779 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.788782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.789535 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:41.789545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.790146 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.790150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:41.790228 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.790245 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 18:42:41.790332 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 18:42:41.790398 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":40,"thread_start_us":151,"threads_started":1}
I20260808 18:42:41.791237 31958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffa0b79ce2c4c909831979815bcd512" candidate_uuid: "564a432df78e4c6aacf77e57e9db92e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5368eff2926745929d43eff686b6b90c" is_pre_election: true
I20260808 18:42:41.791231 32178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffa0b79ce2c4c909831979815bcd512" candidate_uuid: "564a432df78e4c6aacf77e57e9db92e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" is_pre_election: true
I20260808 18:42:41.791572 31958 raft_consensus.cc:2454] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564a432df78e4c6aacf77e57e9db92e9 in term 0.
I20260808 18:42:41.791571 32178 raft_consensus.cc:2454] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564a432df78e4c6aacf77e57e9db92e9 in term 0.
I20260808 18:42:41.792107 32269 leader_election.cc:302] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5368eff2926745929d43eff686b6b90c, 564a432df78e4c6aacf77e57e9db92e9, 6bda9674cf14455a9d7c7b38245eb5cb; no voters:
I20260808 18:42:41.792384 32486 raft_consensus.cc:2781] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:41.792471 32486 raft_consensus.cc:482] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:41.792534 32486 raft_consensus.cc:3037] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:41.793604 32486 raft_consensus.cc:504] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.793951 32486 leader_election.cc:288] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [CANDIDATE]: Term 1 election: Requested vote from peers 5368eff2926745929d43eff686b6b90c (127.4.61.193:37003), 6bda9674cf14455a9d7c7b38245eb5cb (127.4.61.194:46881)
I20260808 18:42:41.794294 31958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffa0b79ce2c4c909831979815bcd512" candidate_uuid: "564a432df78e4c6aacf77e57e9db92e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5368eff2926745929d43eff686b6b90c"
I20260808 18:42:41.794294 32178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffa0b79ce2c4c909831979815bcd512" candidate_uuid: "564a432df78e4c6aacf77e57e9db92e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bda9674cf14455a9d7c7b38245eb5cb"
I20260808 18:42:41.794440 32178 raft_consensus.cc:3037] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:41.794447 31958 raft_consensus.cc:3037] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 0 FOLLOWER]: Advancing to term 1
W20260808 18:42:41.794898 32242 tablet.cc:2369] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:41.795678 32178 raft_consensus.cc:2454] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 564a432df78e4c6aacf77e57e9db92e9 in term 1.
I20260808 18:42:41.795678 31958 raft_consensus.cc:2454] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 564a432df78e4c6aacf77e57e9db92e9 in term 1.
I20260808 18:42:41.795969 32269 leader_election.cc:302] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 564a432df78e4c6aacf77e57e9db92e9, 6bda9674cf14455a9d7c7b38245eb5cb; no voters:
I20260808 18:42:41.796140 32486 raft_consensus.cc:2781] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:41.796366 32486 raft_consensus.cc:686] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 1 LEADER]: Becoming Leader. State: Replica: 564a432df78e4c6aacf77e57e9db92e9, State: Running, Role: LEADER
I20260808 18:42:41.796703 32486 consensus_queue.cc:237] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } }
I20260808 18:42:41.799798 31721 catalog_manager.cc:5495] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 564a432df78e4c6aacf77e57e9db92e9 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "564a432df78e4c6aacf77e57e9db92e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "564a432df78e4c6aacf77e57e9db92e9" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 } health_report { overall_health: UNKNOWN } } }
I20260808 18:42:41.840044 32476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.836872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45672 (local address 127.4.61.195:34975)
0808 18:42:41.837001 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:41.837004 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:41.837018 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:42:41.837101 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:41.837103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:41.837160 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:41.837247 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:41.837475 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.837989 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.838802 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:41.839011 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:41.839080 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:41.839311 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:41.839743 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:41.839829 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:41.839858 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 18:42:41.839903 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:42:41.846240 31958 raft_consensus.cc:1261] T 9ffa0b79ce2c4c909831979815bcd512 P 5368eff2926745929d43eff686b6b90c [term 1 FOLLOWER]: Refusing update from remote peer 564a432df78e4c6aacf77e57e9db92e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:41.846249 32178 raft_consensus.cc:1261] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 1 FOLLOWER]: Refusing update from remote peer 564a432df78e4c6aacf77e57e9db92e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:41.847002 32486 consensus_queue.cc:1035] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5368eff2926745929d43eff686b6b90c" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:41.847220 32491 consensus_queue.cc:1035] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bda9674cf14455a9d7c7b38245eb5cb" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 46881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:41.856725 32497 mvcc.cc:205] Tried to move back new op lower bound from 7316334845314555904 to 7316334845121744896. Current Snapshot: MvccSnapshot[applied={T|T < 7316334845314555904}]
I20260808 18:42:41.863867 31722 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:41.864071 31722 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:41.866648 31722 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6e99179f440842779b74df1ed4e87a36: Sending DeleteTablet for 3 replicas of tablet 9ffa0b79ce2c4c909831979815bcd512
I20260808 18:42:41.867488 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:41 UTC) from {username='slave'} at 127.0.0.1:45656
I20260808 18:42:41.867965 32513 tablet_replica.cc:330] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: stopping tablet replica
I20260808 18:42:41.868078 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 31819
I20260808 18:42:41.868120 31927 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:41 UTC) from {username='slave'} at 127.0.0.1:55862
I20260808 18:42:41.868268 32513 raft_consensus.cc:2229] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:41.868566 32513 raft_consensus.cc:2258] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:41.872285 32142 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ffa0b79ce2c4c909831979815bcd512 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:41 UTC) from {username='slave'} at 127.0.0.1:56778
I20260808 18:42:41.873948 32515 tablet_replica.cc:330] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: stopping tablet replica
I20260808 18:42:41.874343 32515 raft_consensus.cc:2229] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:41.874702 32515 raft_consensus.cc:2258] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:41.876799 32515 ts_tablet_manager.cc:1905] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:41.879982 32515 ts_tablet_manager.cc:1918] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:41.880134 32515 log.cc:1196] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/9ffa0b79ce2c4c909831979815bcd512
I20260808 18:42:41.880470 32515 ts_tablet_manager.cc:1939] T 9ffa0b79ce2c4c909831979815bcd512 P 6bda9674cf14455a9d7c7b38245eb5cb: Deleting consensus metadata
I20260808 18:42:41.881721 31698 catalog_manager.cc:4841] TS 6bda9674cf14455a9d7c7b38245eb5cb (127.4.61.194:46881): tablet 9ffa0b79ce2c4c909831979815bcd512 (table test-table [id=78544d6f645e478c914bc5f034b2d70e]) successfully deleted
I20260808 18:42:41.884680 32513 ts_tablet_manager.cc:1905] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:41.887332 32513 ts_tablet_manager.cc:1918] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:41.887449 32513 log.cc:1196] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/9ffa0b79ce2c4c909831979815bcd512
I20260808 18:42:41.887830 32513 ts_tablet_manager.cc:1939] T 9ffa0b79ce2c4c909831979815bcd512 P 564a432df78e4c6aacf77e57e9db92e9: Deleting consensus metadata
I20260808 18:42:41.889043 31695 catalog_manager.cc:4841] TS 564a432df78e4c6aacf77e57e9db92e9 (127.4.61.195:34975): tablet 9ffa0b79ce2c4c909831979815bcd512 (table test-table [id=78544d6f645e478c914bc5f034b2d70e]) successfully deleted
W20260808 18:42:41.891672 31695 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:37003 (error 108)
I20260808 18:42:41.891834 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 32043
I20260808 18:42:41.899188 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:41.898892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37003 (local address 127.0.0.1:55874)
0808 18:42:41.899031 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:41.899103 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 18:42:41.899474 31695 catalog_manager.cc:4584] TS 5368eff2926745929d43eff686b6b90c (127.4.61.193:37003): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9ffa0b79ce2c4c909831979815bcd512: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37003: connect: Connection refused (error 111)
I20260808 18:42:41.902791 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 32244
I20260808 18:42:41.915232 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 31671
2026-08-08T18:42:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1311 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:41 dist-test-slave-fgb3 krb5kdc[32525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:41 dist-test-slave-fgb3 krb5kdc[32525](info): set up 2 sockets
Aug 08 18:42:41 dist-test-slave-fgb3 krb5kdc[32525](info): commencing operation
krb5kdc: starting...
W20260808 18:42:43.077136 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:42:43.198642 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35181
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:35181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:43.311256 32545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:43.311504 32545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:43.311551 32545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:43.315887 32545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:43.315990 32545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:43.316030 32545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:43.316064 32545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:43.316097 32545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:43.323376 32545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:35181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:43.324596 32545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:43.325915 32545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:42:43.334107 32545 server_base.cc:1034] running on GCE node
W20260808 18:42:43.334031 32551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:43.334039 32554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:43.334033 32552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:43.335063 32545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:43.336166 32545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:43.337322 32545 hybrid_clock.cc:648] HybridClock initialized: now 1786214563337308 us; error 30 us; skew 500 ppm
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:43.343786 32545 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:42:43.344682 32545 webserver.cc:460] Webserver started at http://127.4.61.254:39209/ using document root <none> and password file <none>
I20260808 18:42:43.345260 32545 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:43.345330 32545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:43.345535 32545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:43.347584 32545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "564823e430cb42fd893b7d3bf6de443b"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "33dcbb517ed1925bb53a73143c2369e7"
server_key_iv: "5fe5d62fd1b49fa397a650289f215dd4"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.348147 32545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "564823e430cb42fd893b7d3bf6de443b"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "33dcbb517ed1925bb53a73143c2369e7"
server_key_iv: "5fe5d62fd1b49fa397a650289f215dd4"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.351722 32545 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:43.353955 32566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.355170 32545 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:43.355284 32545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "564823e430cb42fd893b7d3bf6de443b"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "33dcbb517ed1925bb53a73143c2369e7"
server_key_iv: "5fe5d62fd1b49fa397a650289f215dd4"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.355376 32545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:43.385094 32545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:43.388142 32545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:43.388336 32545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:43.395182 32545 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:35181
I20260808 18:42:43.395200 32651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:35181 every 8 connection(s)
I20260808 18:42:43.396170 32545 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:43.399021 32652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:43.404703 32652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: Bootstrap starting.
I20260808 18:42:43.406009 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 32545
I20260808 18:42:43.406127 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:43.406471 4343 external_mini_cluster.cc:1428] Setting key 19f6917b54fbb8719f10593e160943cd
I20260808 18:42:43.407343 32652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:43.408212 32652 log.cc:824] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:43.410362 32652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: No bootstrap required, opened a new log
I20260808 18:42:43.414352 32652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } }
I20260808 18:42:43.414582 32652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:43.414633 32652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564823e430cb42fd893b7d3bf6de443b, State: Initialized, Role: FOLLOWER
I20260808 18:42:43.415068 32652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } }
I20260808 18:42:43.415226 32652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:43.415293 32652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:43.415395 32652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 0 FOLLOWER]: Advancing to term 1
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:43.416368 32652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } }
I20260808 18:42:43.416738 32652 leader_election.cc:302] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564823e430cb42fd893b7d3bf6de443b; no voters:
I20260808 18:42:43.417086 32652 leader_election.cc:288] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:43.417182 32658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:43.417398 32658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [term 1 LEADER]: Becoming Leader. State: Replica: 564823e430cb42fd893b7d3bf6de443b, State: Running, Role: LEADER
I20260808 18:42:43.417747 32658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } }
I20260808 18:42:43.418435 32652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:43.419003 32661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564823e430cb42fd893b7d3bf6de443b. Latest consensus state: current_term: 1 leader_uuid: "564823e430cb42fd893b7d3bf6de443b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } } }
I20260808 18:42:43.419792 32661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:43.419674 32659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564823e430cb42fd893b7d3bf6de443b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564823e430cb42fd893b7d3bf6de443b" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35181 } } }
I20260808 18:42:43.420128 32659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:43.421674 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:43.407567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58176 (local address 127.4.61.254:35181)
0808 18:42:43.408037 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:43.408056 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:43.408103 (+ 47us) server_negotiation.cc:407] Connection header received
0808 18:42:43.408905 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:43.408938 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:43.409339 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:43.409691 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:43.410362 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.411856 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.412683 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.413414 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.413573 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:43.416094 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:43.416101 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:43.416117 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:43.416149 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:43.418035 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.418571 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.418578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.418584 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.418716 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.419036 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.419039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.419041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.419560 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:43.419739 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:43.420441 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 18:42:43.420737 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":140,"threads_started":1}
W20260808 18:42:43.423486 32684 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:42:43.423552 32684 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:42:43.423607 32672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:43.424363 32672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:43.429651 32672 catalog_manager.cc:1347] Generated new cluster ID: 39b8c28dbcab4f90af2bbd516ff5765a
I20260808 18:42:43.429713 32672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:43.447831 32672 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:43.449085 32672 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:43.458904 32672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: Generated new TSK 0
I20260808 18:42:43.459597 32672 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:42:43.490841 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:43.603197 32692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:43.603475 32692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:43.603538 32692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:43.607553 32692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:43.607612 32692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:43.607692 32692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:43.612890 32692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:43.613955 32692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:43.615018 32692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:43.624624 32702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:43.624732 32692 server_base.cc:1034] running on GCE node
W20260808 18:42:43.624671 32703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:43.624624 32705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:43.625376 32692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:43.625984 32692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:43.627139 32692 hybrid_clock.cc:648] HybridClock initialized: now 1786214563627120 us; error 30 us; skew 500 ppm
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:43.629763 32692 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:42:43.630705 32692 webserver.cc:460] Webserver started at http://127.4.61.193:41291/ using document root <none> and password file <none>
I20260808 18:42:43.631260 32692 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:43.631330 32692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:43.631558 32692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:43.633663 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "d9635c9d7e9749749098d64cf2c8f452"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "8a349e08714633730fc4056a0d69828e"
server_key_iv: "4b5529d3d14e2f6c3a81e31823b1aaf2"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.634225 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "d9635c9d7e9749749098d64cf2c8f452"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "8a349e08714633730fc4056a0d69828e"
server_key_iv: "4b5529d3d14e2f6c3a81e31823b1aaf2"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.637990 32692 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:43.640563 32717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.641827 32692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:43.641935 32692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "d9635c9d7e9749749098d64cf2c8f452"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "8a349e08714633730fc4056a0d69828e"
server_key_iv: "4b5529d3d14e2f6c3a81e31823b1aaf2"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.642040 32692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:43.661438 32692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:43.664707 32692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:43.664896 32692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:43.665532 32692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:43.666463 32692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:43.666513 32692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.666558 32692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:43.666585 32692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.675401 32692 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:36417
I20260808 18:42:43.675477 426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:36417 every 8 connection(s)
I20260808 18:42:43.676326 32692 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:43.677448 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 32692
I20260808 18:42:43.677590 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:43.677929 4343 external_mini_cluster.cc:1428] Setting key a01eb4225b6c195925ee2f402743a8a4
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:42:43.691167 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:43.678428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:59281 (local address 127.4.61.254:35181)
0808 18:42:43.678582 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:43.678587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:43.679534 (+ 947us) server_negotiation.cc:407] Connection header received
0808 18:42:43.681230 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:43.681233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:43.681279 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:43.681336 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:43.682702 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.683455 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.684627 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.684994 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.685108 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:43.687684 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:43.687687 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:43.687689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:43.687715 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:43.689152 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.689674 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.689676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.689678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.689768 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.690088 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.690095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.690096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.690298 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:43.690417 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:43.690897 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 18:42:43.691026 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:42:43.692008 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:43.678809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35181 (local address 127.4.61.193:59281)
0808 18:42:43.679394 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:43.679448 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:43.680984 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:43.681544 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:43.681553 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:43.682017 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:43.682561 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:43.682576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.683587 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.683590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:43.684497 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:43.684507 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.685135 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.685138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:43.685290 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:43.685893 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:43.685909 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:43.687505 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:43.689265 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:43.689270 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:43.689283 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:43.689567 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:43.689836 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:43.689838 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:43.689840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:43.689969 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:43.690424 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:43.690429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:43.690679 (+ 250us) client_negotiation.cc:769] Sending connection context
0808 18:42:43.690830 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 18:42:43.691110 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":143,"threads_started":1}
I20260808 18:42:43.693324 427 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35181
I20260808 18:42:43.693573 427 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:43.694118 427 heartbeater.cc:511] Master 127.4.61.254:35181 requested a full tablet report, sending...
I20260808 18:42:43.696012 32597 ts_manager.cc:194] Registered new tserver with Master: d9635c9d7e9749749098d64cf2c8f452 (127.4.61.193:36417)
I20260808 18:42:43.697654 32597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:59281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:42:43.707358 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:43.820983 435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:43.821220 435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:43.821260 435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:43.825155 435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:43.825204 435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:43.825263 435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:43.830199 435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:43.831161 435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:43.832088 435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:43.841226 443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:43.841208 446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:43.841207 441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:43.841449 435 server_base.cc:1034] running on GCE node
I20260808 18:42:43.841897 435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:43.842556 435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:43.843708 435 hybrid_clock.cc:648] HybridClock initialized: now 1786214563843677 us; error 39 us; skew 500 ppm
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:43.846293 435 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:42:43.847132 435 webserver.cc:460] Webserver started at http://127.4.61.194:38629/ using document root <none> and password file <none>
I20260808 18:42:43.847635 435 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:43.847688 435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:43.847846 435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:43.849782 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "9429dfb6f70b40bf90b7af67f9110421"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "7db52b259a150b460686c2a1942e3fc8"
server_key_iv: "f25aa1108652fb7b85ca2d2ef622ebfa"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.850284 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "9429dfb6f70b40bf90b7af67f9110421"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "7db52b259a150b460686c2a1942e3fc8"
server_key_iv: "f25aa1108652fb7b85ca2d2ef622ebfa"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.853749 435 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:43.856165 461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.857344 435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:43.857450 435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "9429dfb6f70b40bf90b7af67f9110421"
format_stamp: "Formatted at 2026-08-08 18:42:43 on dist-test-slave-fgb3"
server_key: "7db52b259a150b460686c2a1942e3fc8"
server_key_iv: "f25aa1108652fb7b85ca2d2ef622ebfa"
server_key_version: "encryptionkey@0"
I20260808 18:42:43.857542 435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:43.870441 435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:43.873099 435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:43.873279 435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:43.873858 435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:43.874933 435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:43.874992 435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.875046 435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:43.875077 435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:43.883615 435 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:33597
I20260808 18:42:43.883643 654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:33597 every 8 connection(s)
I20260808 18:42:43.884497 435 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
Aug 08 18:42:43 dist-test-slave-fgb3 krb5kdc[32525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214563, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:43.894547 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 435
I20260808 18:42:43.894675 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:43.894953 4343 external_mini_cluster.cc:1428] Setting key 579f010fb03f216c2cace88bbe0415e2
I20260808 18:42:43.897364 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:43.886262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:51407 (local address 127.4.61.254:35181)
0808 18:42:43.886421 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:43.886424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:43.887263 (+ 839us) server_negotiation.cc:407] Connection header received
0808 18:42:43.888578 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:43.888581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:43.888636 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:43.888710 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:43.889845 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.890424 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.891564 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.891777 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.891853 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:43.894064 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:43.894066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:43.894069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:43.894092 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:43.895459 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.895927 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.895931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.895933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.896011 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:43.896332 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:43.896336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:43.896337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:43.896519 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:43.896605 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:43.897087 (+ 482us) server_negotiation.cc:299] Negotiation successful
0808 18:42:43.897204 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 18:42:43.898358 660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:43.886640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35181 (local address 127.4.61.194:51407)
0808 18:42:43.887112 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:43.887154 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:43.888373 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:43.888885 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:43.888891 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:43.889238 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:43.889703 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:43.889716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.890562 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.890565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:43.891457 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:43.891468 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:43.891890 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:43.891892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:43.892030 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:43.892512 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:43.892528 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:43.893897 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:43.895566 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:43.895571 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:43.895586 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:43.895833 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:43.896092 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:43.896095 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:43.896097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:43.896243 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:43.896616 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:43.896622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:43.896853 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 18:42:43.897027 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 18:42:43.897340 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":116,"threads_started":1}
I20260808 18:42:43.899485 655 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35181
I20260808 18:42:43.899708 655 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:43.900193 655 heartbeater.cc:511] Master 127.4.61.254:35181 requested a full tablet report, sending...
I20260808 18:42:43.901259 32597 ts_manager.cc:194] Registered new tserver with Master: 9429dfb6f70b40bf90b7af67f9110421 (127.4.61.194:33597)
I20260808 18:42:43.901834 32597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:51407
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:42:43.920874 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:44.031903 664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:44.032202 664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:44.032263 664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:44.036391 664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:44.036459 664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:44.036543 664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:44.042007 664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:35181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:44.043150 664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:44.044201 664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:44.053709 674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.053704 673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.053704 676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:44.053965 664 server_base.cc:1034] running on GCE node
I20260808 18:42:44.054435 664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:44.055042 664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:44.056191 664 hybrid_clock.cc:648] HybridClock initialized: now 1786214564056166 us; error 36 us; skew 500 ppm
Aug 08 18:42:44 dist-test-slave-fgb3 krb5kdc[32525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214564, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:44.058845 664 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:42:44.059777 664 webserver.cc:460] Webserver started at http://127.4.61.195:37977/ using document root <none> and password file <none>
I20260808 18:42:44.060320 664 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:44.060387 664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:44.060576 664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:44.062651 664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "d1a17852342d4448aba3f5a537627f69"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "fe410a22a817baa42e491599c31eefa3"
server_key_iv: "f4ca80c2cbf1bd1e8cc9777ce21a7330"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.063205 664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "d1a17852342d4448aba3f5a537627f69"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "fe410a22a817baa42e491599c31eefa3"
server_key_iv: "f4ca80c2cbf1bd1e8cc9777ce21a7330"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.066913 664 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:42:44.069334 686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.070546 664 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:44.070660 664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "d1a17852342d4448aba3f5a537627f69"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "fe410a22a817baa42e491599c31eefa3"
server_key_iv: "f4ca80c2cbf1bd1e8cc9777ce21a7330"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.070751 664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:44.093430 664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:44.096316 664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:44.096508 664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:44.097133 664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:44.098038 664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:44.098088 664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.098143 664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:44.098173 664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.107041 664 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:41935
I20260808 18:42:44.107098 872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:41935 every 8 connection(s)
I20260808 18:42:44.107956 664 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
Aug 08 18:42:44 dist-test-slave-fgb3 krb5kdc[32525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214564, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:44.117313 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 664
I20260808 18:42:44.117439 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:44.117717 4343 external_mini_cluster.cc:1428] Setting key d46b2008823d908e04633fb3e934c589
I20260808 18:42:44.121332 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.109731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:53539 (local address 127.4.61.254:35181)
0808 18:42:44.109870 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.109873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.110726 (+ 853us) server_negotiation.cc:407] Connection header received
0808 18:42:44.112154 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.112158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.112216 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.112294 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:44.113471 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.114010 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.115202 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.115435 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.115536 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.117930 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:44.117933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:44.117935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:44.117958 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:44.119421 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:44.119872 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:44.119876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:44.119878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:44.119965 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:44.120317 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:44.120320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:44.120322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:44.120499 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:44.120584 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.121053 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.121176 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:42:44.122103 876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.110090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:35181 (local address 127.4.61.195:53539)
0808 18:42:44.110576 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.110620 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.111930 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.112479 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.112486 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.112846 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:44.113321 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.113335 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.114131 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.114134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.115079 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.115088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.115600 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.115604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.115758 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.116257 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:44.116272 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:44.117772 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:44.119521 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:44.119527 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:44.119540 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:44.119779 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:44.120040 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:44.120044 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:44.120046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:44.120229 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:44.120598 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:44.120604 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:44.120830 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.120990 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.121291 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":105,"threads_started":1}
I20260808 18:42:44.123107 873 heartbeater.cc:347] Connected to a master server at 127.4.61.254:35181
I20260808 18:42:44.123330 873 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:44.123790 873 heartbeater.cc:511] Master 127.4.61.254:35181 requested a full tablet report, sending...
I20260808 18:42:44.124768 32597 ts_manager.cc:194] Registered new tserver with Master: d1a17852342d4448aba3f5a537627f69 (127.4.61.195:41935)
I20260808 18:42:44.125268 32597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:53539
I20260808 18:42:44.131434 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:44.140575 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.133308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40560 (local address 127.4.61.254:35181)
0808 18:42:44.133416 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.133420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.133619 (+ 199us) server_negotiation.cc:407] Connection header received
0808 18:42:44.133737 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.133740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.133781 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.133852 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:44.134543 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.135043 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.135937 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.136154 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.136237 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.137656 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:44.137660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:44.137663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:44.137686 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:44.138854 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:44.139347 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:44.139351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:44.139353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:44.139428 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:44.139733 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:44.139736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:44.139738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:44.139935 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:44.140070 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.140340 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.140429 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 18:42:44.143282 32597 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:44.146401 32597 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:44.160353 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.154771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36417 (local address 127.0.0.1:56768)
0808 18:42:44.155265 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.155278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.155365 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.156137 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.156140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.156161 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:44.156242 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.156248 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.157621 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.157625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.158828 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.158838 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.159932 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.159936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.160022 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.160043 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.160120 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.160194 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":44,"thread_start_us":114,"threads_started":1}
I20260808 18:42:44.160374 894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.155237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.4.61.193:36417)
0808 18:42:44.155648 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.155664 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.155688 (+ 24us) server_negotiation.cc:407] Connection header received
0808 18:42:44.155764 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.155769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.155962 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.156139 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:44.156366 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.157477 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.158969 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.159786 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.159929 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.160065 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.160150 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.160239 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":119,"threads_started":1}
I20260808 18:42:44.160575 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.154534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50104 (local address 127.4.61.194:33597)
0808 18:42:44.154995 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.155008 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.155033 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:42:44.155113 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.155119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.155339 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.155945 (+ 606us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:44.156119 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.157013 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.158714 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.159571 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.159681 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.159837 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.160276 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.160374 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":148,"threads_started":1}
I20260808 18:42:44.160599 893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.155092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:41935 (local address 127.0.0.1:48474)
0808 18:42:44.155922 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.155936 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.156016 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.156835 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.156839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.156857 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:44.156939 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.156944 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.158075 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.158079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.159116 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.159127 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.160254 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.160258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.160337 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.160358 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.160424 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.160484 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":3,"thread_start_us":78,"threads_started":1}
I20260808 18:42:44.160784 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.154357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:33597 (local address 127.0.0.1:50104)
0808 18:42:44.154705 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.154772 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.154900 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.155578 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.155593 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.155626 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:44.155770 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.155778 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.157122 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.157125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.158580 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.158591 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.159734 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.159740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.159851 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.159896 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.160009 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.160133 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":21,"thread_start_us":74,"threads_started":1}
I20260808 18:42:44.161038 895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.155545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48474 (local address 127.4.61.195:41935)
0808 18:42:44.156428 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.156440 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.156461 (+ 21us) server_negotiation.cc:407] Connection header received
0808 18:42:44.156532 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.156537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.156705 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.156850 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:44.157046 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.157943 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.159240 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.159970 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.160055 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.160181 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.160804 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.160897 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":100,"threads_started":1}
I20260808 18:42:44.163954 324 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb6fe414b8343678c479a0880f54668 (DEFAULT_TABLE table=test-table [id=ad5df297463f4b8bbfd90673bbcddf4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:44.163982 771 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb6fe414b8343678c479a0880f54668 (DEFAULT_TABLE table=test-table [id=ad5df297463f4b8bbfd90673bbcddf4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:44.163990 535 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb6fe414b8343678c479a0880f54668 (DEFAULT_TABLE table=test-table [id=ad5df297463f4b8bbfd90673bbcddf4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:44.164964 324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb6fe414b8343678c479a0880f54668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:44.165010 535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb6fe414b8343678c479a0880f54668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:44.165017 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb6fe414b8343678c479a0880f54668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:44.171212 896 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: Bootstrap starting.
I20260808 18:42:44.172670 897 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Bootstrap starting.
I20260808 18:42:44.173079 898 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Bootstrap starting.
I20260808 18:42:44.173573 896 tablet_bootstrap.cc:654] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:44.174504 897 tablet_bootstrap.cc:654] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:44.175021 896 log.cc:824] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:44.175158 898 tablet_bootstrap.cc:654] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:44.175621 897 log.cc:824] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:44.176376 898 log.cc:824] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:44.177321 896 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: No bootstrap required, opened a new log
I20260808 18:42:44.177330 897 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: No bootstrap required, opened a new log
I20260808 18:42:44.177518 896 ts_tablet_manager.cc:1397] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 18:42:44.177518 897 ts_tablet_manager.cc:1397] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:42:44.178049 898 tablet_bootstrap.cc:492] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: No bootstrap required, opened a new log
I20260808 18:42:44.178228 898 ts_tablet_manager.cc:1397] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:42:44.180960 898 raft_consensus.cc:348] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.181190 898 raft_consensus.cc:374] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:44.181254 898 raft_consensus.cc:729] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a17852342d4448aba3f5a537627f69, State: Initialized, Role: FOLLOWER
I20260808 18:42:44.181368 897 raft_consensus.cc:348] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.181368 896 raft_consensus.cc:348] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.181629 896 raft_consensus.cc:374] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:44.181629 897 raft_consensus.cc:374] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:44.181685 896 raft_consensus.cc:729] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9635c9d7e9749749098d64cf2c8f452, State: Initialized, Role: FOLLOWER
I20260808 18:42:44.181685 897 raft_consensus.cc:729] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9429dfb6f70b40bf90b7af67f9110421, State: Initialized, Role: FOLLOWER
I20260808 18:42:44.181672 898 consensus_queue.cc:260] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.182104 897 consensus_queue.cc:260] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.182104 896 consensus_queue.cc:260] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.182669 898 ts_tablet_manager.cc:1428] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260808 18:42:44.183020 873 heartbeater.cc:503] Master 127.4.61.254:35181 was elected leader, sending a full tablet report...
I20260808 18:42:44.183050 897 ts_tablet_manager.cc:1428] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 18:42:44.183050 896 ts_tablet_manager.cc:1428] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260808 18:42:44.183358 655 heartbeater.cc:503] Master 127.4.61.254:35181 was elected leader, sending a full tablet report...
I20260808 18:42:44.183359 427 heartbeater.cc:503] Master 127.4.61.254:35181 was elected leader, sending a full tablet report...
I20260808 18:42:44.205792 915 raft_consensus.cc:482] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:44.206022 915 raft_consensus.cc:504] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.207192 915 leader_election.cc:288] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9429dfb6f70b40bf90b7af67f9110421 (127.4.61.194:33597), d1a17852342d4448aba3f5a537627f69 (127.4.61.195:41935)
I20260808 18:42:44.210832 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.207504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:52055 (local address 127.4.61.194:33597)
0808 18:42:44.207633 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.207636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.207739 (+ 103us) server_negotiation.cc:407] Connection header received
0808 18:42:44.207943 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.207946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.208000 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.208087 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:44.208339 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.208834 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.209888 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.210293 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.210418 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.210463 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.210653 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.210706 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:42:44.210868 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.207406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:33597 (local address 127.4.61.193:52055)
0808 18:42:44.207662 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.207677 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.207787 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.208102 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.208106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.208126 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:44.208238 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.208243 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.208939 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.208943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.209762 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.209771 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.210424 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.210428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.210536 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.210565 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.210643 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.210708 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":89,"threads_started":1}
I20260808 18:42:44.211249 919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.207795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:41935 (local address 127.4.61.193:58761)
0808 18:42:44.208101 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.208112 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.208206 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.208417 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.208420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.208435 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:44.208575 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.208580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.209295 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.209298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.210053 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.210062 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.210807 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.210811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.210911 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.210935 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.211049 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.211119 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":133,"threads_started":1}
I20260808 18:42:44.211267 895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.207904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:58761 (local address 127.4.61.195:41935)
0808 18:42:44.208023 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.208027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.208191 (+ 164us) server_negotiation.cc:407] Connection header received
0808 18:42:44.208288 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.208292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.208336 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.208395 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:44.208678 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.209187 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.210168 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.210696 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.210803 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.210849 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.211078 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.211157 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:42:44.211512 570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb6fe414b8343678c479a0880f54668" candidate_uuid: "d9635c9d7e9749749098d64cf2c8f452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9429dfb6f70b40bf90b7af67f9110421" is_pre_election: true
I20260808 18:42:44.211812 570 raft_consensus.cc:2454] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9635c9d7e9749749098d64cf2c8f452 in term 0.
I20260808 18:42:44.212011 802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb6fe414b8343678c479a0880f54668" candidate_uuid: "d9635c9d7e9749749098d64cf2c8f452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a17852342d4448aba3f5a537627f69" is_pre_election: true
I20260808 18:42:44.212296 802 raft_consensus.cc:2454] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9635c9d7e9749749098d64cf2c8f452 in term 0.
I20260808 18:42:44.212296 32724 leader_election.cc:302] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9429dfb6f70b40bf90b7af67f9110421, d9635c9d7e9749749098d64cf2c8f452; no voters:
I20260808 18:42:44.212582 915 raft_consensus.cc:2781] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:44.212687 915 raft_consensus.cc:482] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:44.212744 915 raft_consensus.cc:3037] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:44.213768 915 raft_consensus.cc:504] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.214100 915 leader_election.cc:288] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [CANDIDATE]: Term 1 election: Requested vote from peers 9429dfb6f70b40bf90b7af67f9110421 (127.4.61.194:33597), d1a17852342d4448aba3f5a537627f69 (127.4.61.195:41935)
I20260808 18:42:44.214470 570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb6fe414b8343678c479a0880f54668" candidate_uuid: "d9635c9d7e9749749098d64cf2c8f452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9429dfb6f70b40bf90b7af67f9110421"
I20260808 18:42:44.214560 802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb6fe414b8343678c479a0880f54668" candidate_uuid: "d9635c9d7e9749749098d64cf2c8f452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a17852342d4448aba3f5a537627f69"
I20260808 18:42:44.214603 570 raft_consensus.cc:3037] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:44.214686 802 raft_consensus.cc:3037] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:44.215695 570 raft_consensus.cc:2454] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9635c9d7e9749749098d64cf2c8f452 in term 1.
I20260808 18:42:44.215863 802 raft_consensus.cc:2454] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9635c9d7e9749749098d64cf2c8f452 in term 1.
I20260808 18:42:44.215991 32724 leader_election.cc:302] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9429dfb6f70b40bf90b7af67f9110421, d9635c9d7e9749749098d64cf2c8f452; no voters:
I20260808 18:42:44.216262 915 raft_consensus.cc:2781] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:44.216468 915 raft_consensus.cc:686] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [term 1 LEADER]: Becoming Leader. State: Replica: d9635c9d7e9749749098d64cf2c8f452, State: Running, Role: LEADER
I20260808 18:42:44.216856 915 consensus_queue.cc:237] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } }
I20260808 18:42:44.219995 32597 catalog_manager.cc:5495] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9635c9d7e9749749098d64cf2c8f452 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "d9635c9d7e9749749098d64cf2c8f452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9635c9d7e9749749098d64cf2c8f452" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 36417 } health_report { overall_health: HEALTHY } } }
I20260808 18:42:44.238435 894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.235182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56770 (local address 127.4.61.193:36417)
0808 18:42:44.235307 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.235311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.235327 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:42:44.235416 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.235418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.235474 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.235554 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:44.235764 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.236262 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.237037 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.237262 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.237347 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.237573 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:44.238049 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:44.238198 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.238239 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.238275 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:42:44.244437 802 raft_consensus.cc:1261] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 1 FOLLOWER]: Refusing update from remote peer d9635c9d7e9749749098d64cf2c8f452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:44.244436 570 raft_consensus.cc:1261] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 1 FOLLOWER]: Refusing update from remote peer d9635c9d7e9749749098d64cf2c8f452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:44.245186 915 consensus_queue.cc:1035] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a17852342d4448aba3f5a537627f69" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 41935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:44.245389 920 consensus_queue.cc:1035] T 1fb6fe414b8343678c479a0880f54668 P d9635c9d7e9749749098d64cf2c8f452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9429dfb6f70b40bf90b7af67f9110421" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:44.254920 926 mvcc.cc:205] Tried to move back new op lower bound from 7316334855137808384 to 7316334855034793984. Current Snapshot: MvccSnapshot[applied={T|T < 7316334855137808384}]
I20260808 18:42:44.255147 928 mvcc.cc:205] Tried to move back new op lower bound from 7316334855137808384 to 7316334855034793984. Current Snapshot: MvccSnapshot[applied={T|T < 7316334855137808384}]
I20260808 18:42:44.262760 32597 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:44.262923 32597 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:44.265206 32597 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 564823e430cb42fd893b7d3bf6de443b: Sending DeleteTablet for 3 replicas of tablet 1fb6fe414b8343678c479a0880f54668
I20260808 18:42:44.266142 324 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb6fe414b8343678c479a0880f54668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:44 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:56768
I20260808 18:42:44.266145 535 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb6fe414b8343678c479a0880f54668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:44 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:50104
I20260808 18:42:44.266729 940 tablet_replica.cc:330] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: stopping tablet replica
I20260808 18:42:44.266866 771 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb6fe414b8343678c479a0880f54668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:44 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:48474
I20260808 18:42:44.267066 940 raft_consensus.cc:2229] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:44.267414 940 raft_consensus.cc:2258] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:44.267444 942 tablet_replica.cc:330] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: stopping tablet replica
I20260808 18:42:44.267717 942 raft_consensus.cc:2229] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:44.267742 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 32692
I20260808 18:42:44.272332 940 ts_tablet_manager.cc:1905] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:44.273444 942 raft_consensus.cc:2258] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:44.274956 942 ts_tablet_manager.cc:1905] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:44.275241 940 ts_tablet_manager.cc:1918] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:44.275343 940 log.cc:1196] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/1fb6fe414b8343678c479a0880f54668
I20260808 18:42:44.275652 940 ts_tablet_manager.cc:1939] T 1fb6fe414b8343678c479a0880f54668 P 9429dfb6f70b40bf90b7af67f9110421: Deleting consensus metadata
I20260808 18:42:44.276988 32571 catalog_manager.cc:4841] TS 9429dfb6f70b40bf90b7af67f9110421 (127.4.61.194:33597): tablet 1fb6fe414b8343678c479a0880f54668 (table test-table [id=ad5df297463f4b8bbfd90673bbcddf4c]) successfully deleted
I20260808 18:42:44.277233 942 ts_tablet_manager.cc:1918] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:44.277333 942 log.cc:1196] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/1fb6fe414b8343678c479a0880f54668
I20260808 18:42:44.277633 942 ts_tablet_manager.cc:1939] T 1fb6fe414b8343678c479a0880f54668 P d1a17852342d4448aba3f5a537627f69: Deleting consensus metadata
I20260808 18:42:44.278744 32571 catalog_manager.cc:4841] TS d1a17852342d4448aba3f5a537627f69 (127.4.61.195:41935): tablet 1fb6fe414b8343678c479a0880f54668 (table test-table [id=ad5df297463f4b8bbfd90673bbcddf4c]) successfully deleted
W20260808 18:42:44.280797 32570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:36417 (error 108)
I20260808 18:42:44.281077 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 435
I20260808 18:42:44.287583 893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.284261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:36417 (local address 127.0.0.1:56780)
0808 18:42:44.287399 (+ 3138us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.287488 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3019}
W20260808 18:42:44.289259 32570 catalog_manager.cc:4584] TS d9635c9d7e9749749098d64cf2c8f452 (127.4.61.193:36417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1fb6fe414b8343678c479a0880f54668: Network error: Client connection negotiation failed: client connection to 127.4.61.193:36417: connect: Connection refused (error 111)
I20260808 18:42:44.294474 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 664
I20260808 18:42:44.317924 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 32545
2026-08-08T18:42:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2404 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T18:42:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:44Z Disabled control of system clock
I20260808 18:42:44.355581 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37831
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:45463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:44.465225 953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:44.465525 953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:44.465575 953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:44.469528 953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:44.469583 953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:44.469604 953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:44.469624 953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:44.469643 953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:44.474268 953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:37831
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:44.475327 953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:44.476651 953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:44.484671 963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.484681 966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:44.484956 953 server_base.cc:1034] running on GCE node
W20260808 18:42:44.485019 960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:44.485530 953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:44.486594 953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:44.487744 953 hybrid_clock.cc:648] HybridClock initialized: now 1786214564487727 us; error 30 us; skew 500 ppm
I20260808 18:42:44.489442 953 webserver.cc:460] Webserver started at http://127.4.61.254:42329/ using document root <none> and password file <none>
I20260808 18:42:44.489987 953 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:44.490049 953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:44.490247 953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:44.492264 953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "5699db0200e346fc9a00e381573e4a66"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "069826f572e32a159367a05655bc35eb"
server_key_iv: "064169f26f30187b36393688812169a4"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.492802 953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "5699db0200e346fc9a00e381573e4a66"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "069826f572e32a159367a05655bc35eb"
server_key_iv: "064169f26f30187b36393688812169a4"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.496315 953 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:42:44.498657 976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.499964 953 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:44.500101 953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "5699db0200e346fc9a00e381573e4a66"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "069826f572e32a159367a05655bc35eb"
server_key_iv: "064169f26f30187b36393688812169a4"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.500219 953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:44.517823 953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:44.518560 953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:44.518740 953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:44.525419 953 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:37831
I20260808 18:42:44.525430 1060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:37831 every 8 connection(s)
I20260808 18:42:44.526355 953 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:44.529460 1061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:44.531407 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 953
I20260808 18:42:44.531546 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:44.531857 4343 external_mini_cluster.cc:1428] Setting key 2cb20cdf58c9003fb94d8a7c7f961fc1
I20260808 18:42:44.535705 1061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: Bootstrap starting.
I20260808 18:42:44.537873 1061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:44.538810 1061 log.cc:824] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:44.541074 1061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: No bootstrap required, opened a new log
I20260808 18:42:44.541814 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.533287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50524 (local address 127.4.61.254:37831)
0808 18:42:44.533922 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.533937 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.533979 (+ 42us) server_negotiation.cc:407] Connection header received
0808 18:42:44.534884 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.534906 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.535336 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.535664 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:44.536118 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.537099 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.538040 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.538794 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.538969 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.539786 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:44.539793 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:44.539808 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:44.540280 (+ 472us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:44.540352 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:44.540380 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:44.540505 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.540596 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.540863 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":130,"threads_started":1}
I20260808 18:42:44.545104 1061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } }
I20260808 18:42:44.545337 1061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:44.545382 1061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5699db0200e346fc9a00e381573e4a66, State: Initialized, Role: FOLLOWER
I20260808 18:42:44.545742 1061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } }
I20260808 18:42:44.545851 1061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:44.545894 1061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:44.545970 1061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:44.546852 1061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } }
I20260808 18:42:44.547156 1061 leader_election.cc:302] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5699db0200e346fc9a00e381573e4a66; no voters:
I20260808 18:42:44.547426 1061 leader_election.cc:288] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:44.547499 1069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:44.547704 1069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [term 1 LEADER]: Becoming Leader. State: Replica: 5699db0200e346fc9a00e381573e4a66, State: Running, Role: LEADER
I20260808 18:42:44.548025 1069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } }
I20260808 18:42:44.548638 1061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:44.549599 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5699db0200e346fc9a00e381573e4a66. Latest consensus state: current_term: 1 leader_uuid: "5699db0200e346fc9a00e381573e4a66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } } }
I20260808 18:42:44.549731 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:44.550000 1070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5699db0200e346fc9a00e381573e4a66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5699db0200e346fc9a00e381573e4a66" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37831 } } }
I20260808 18:42:44.550093 1070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:44.550200 1085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:44.553417 1085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:44.558977 1085 catalog_manager.cc:1347] Generated new cluster ID: d69098c75e6d4124be98b9579395ef17
I20260808 18:42:44.559055 1085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:44.573040 1085 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:44.574040 1085 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:44.585381 1085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: Generated new TSK 0
I20260808 18:42:44.586086 1085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:44.593029 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--builtin_ntp_servers=127.4.61.212:45463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:44.720312 1099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:44.720544 1099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:44.720580 1099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:44.725288 1099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:44.725338 1099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:44.725389 1099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:44.729992 1099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:44.730993 1099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:44.732280 1099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:44.741876 1105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.741981 1110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.741880 1107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:44.742194 1099 server_base.cc:1034] running on GCE node
I20260808 18:42:44.742615 1099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:44.743255 1099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:44.744412 1099 hybrid_clock.cc:648] HybridClock initialized: now 1786214564744387 us; error 37 us; skew 500 ppm
I20260808 18:42:44.746214 1099 webserver.cc:460] Webserver started at http://127.4.61.193:42621/ using document root <none> and password file <none>
I20260808 18:42:44.746793 1099 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:44.746857 1099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:44.747066 1099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:44.749140 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "fbf9a6c02eae4088ae88eaadb0502063"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "5c2f81d4a58f16f445cfdba19fe0ffa2"
server_key_iv: "29c8f6546d9170aa103c2667ab564453"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.749715 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "fbf9a6c02eae4088ae88eaadb0502063"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "5c2f81d4a58f16f445cfdba19fe0ffa2"
server_key_iv: "29c8f6546d9170aa103c2667ab564453"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.753552 1099 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:42:44.756145 1117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.757453 1099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:42:44.757565 1099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "fbf9a6c02eae4088ae88eaadb0502063"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "5c2f81d4a58f16f445cfdba19fe0ffa2"
server_key_iv: "29c8f6546d9170aa103c2667ab564453"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.757686 1099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:44.774296 1099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:44.775084 1099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:44.775270 1099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:44.775892 1099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:44.776897 1099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:44.776954 1099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.777002 1099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:44.777031 1099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.785925 1099 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:46415
I20260808 18:42:44.785972 1299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:46415 every 8 connection(s)
I20260808 18:42:44.786875 1099 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:44.791003 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 1099
I20260808 18:42:44.791154 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:44.791481 4343 external_mini_cluster.cc:1428] Setting key 7605abfe8fa53cde6fe5f18bb5cad588
I20260808 18:42:44.793488 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--builtin_ntp_servers=127.4.61.212:45463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:44.796444 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.788740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:39883 (local address 127.4.61.254:37831)
0808 18:42:44.788874 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.788878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.789933 (+ 1055us) server_negotiation.cc:407] Connection header received
0808 18:42:44.791614 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.791618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.791670 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.791737 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:44.792805 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.793373 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.794611 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.794838 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.794929 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.795985 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:44.795988 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:44.795990 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:44.796002 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:44.796021 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:44.796028 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:44.796086 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.796254 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.796316 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:44.797495 1303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.789125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37831 (local address 127.4.61.193:39883)
0808 18:42:44.789783 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.789823 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.791335 (+ 1512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.791941 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.791949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.792034 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:44.792653 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.792672 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.793504 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.793506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.794498 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.794508 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.794983 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.794987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.795144 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.795706 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:44.795708 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:44.795749 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:44.795840 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:44.796096 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:44.796106 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:44.796113 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.796228 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.796522 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":119,"threads_started":1}
I20260808 18:42:44.798733 1300 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37831
I20260808 18:42:44.798972 1300 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:44.799544 1300 heartbeater.cc:511] Master 127.4.61.254:37831 requested a full tablet report, sending...
I20260808 18:42:44.801079 1002 ts_manager.cc:194] Registered new tserver with Master: fbf9a6c02eae4088ae88eaadb0502063 (127.4.61.193:46415)
I20260808 18:42:44.802234 1002 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.193:39883
W20260808 18:42:44.906986 1304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:44.907248 1304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:44.907294 1304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:44.911288 1304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:44.911339 1304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:44.911401 1304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:44.916061 1304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:44.917091 1304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:44.918516 1304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:44.927759 1312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.927763 1315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:44.927723 1313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:44.927881 1304 server_base.cc:1034] running on GCE node
I20260808 18:42:44.928319 1304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:44.928894 1304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:44.930055 1304 hybrid_clock.cc:648] HybridClock initialized: now 1786214564930040 us; error 27 us; skew 500 ppm
I20260808 18:42:44.931823 1304 webserver.cc:460] Webserver started at http://127.4.61.194:40533/ using document root <none> and password file <none>
I20260808 18:42:44.932376 1304 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:44.932443 1304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:44.932631 1304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:44.934679 1304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "c5ba5144f2734d98be75eecfc5975069"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "489c36a5f48a84fb54045445398dc9fd"
server_key_iv: "09d55a9dbef8cfe16af2c4cc74ad9445"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.935194 1304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "c5ba5144f2734d98be75eecfc5975069"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "489c36a5f48a84fb54045445398dc9fd"
server_key_iv: "09d55a9dbef8cfe16af2c4cc74ad9445"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.938798 1304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:44.941074 1324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.942180 1304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:44.942303 1304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "c5ba5144f2734d98be75eecfc5975069"
format_stamp: "Formatted at 2026-08-08 18:42:44 on dist-test-slave-fgb3"
server_key: "489c36a5f48a84fb54045445398dc9fd"
server_key_iv: "09d55a9dbef8cfe16af2c4cc74ad9445"
server_key_version: "encryptionkey@0"
I20260808 18:42:44.942435 1304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:44.967793 1304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:44.968585 1304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:44.968781 1304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:44.969410 1304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:44.970451 1304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:44.970503 1304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.970561 1304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:44.970592 1304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:44.979455 1304 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:42581
I20260808 18:42:44.979496 1517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:42581 every 8 connection(s)
I20260808 18:42:44.980371 1304 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:44.980921 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 1304
I20260808 18:42:44.981035 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:44.981350 4343 external_mini_cluster.cc:1428] Setting key 62b61c8fdea0aed17e2e7e6f13a7e3d7
I20260808 18:42:44.983704 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--builtin_ntp_servers=127.4.61.212:45463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:44.989728 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.982333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:54243 (local address 127.4.61.254:37831)
0808 18:42:44.982460 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:44.982464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:44.983682 (+ 1218us) server_negotiation.cc:407] Connection header received
0808 18:42:44.985113 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:44.985116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:44.985171 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:44.985253 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:44.986160 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.986746 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.987881 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.988098 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.988188 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.989277 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:44.989280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:44.989282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:44.989294 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:44.989312 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:44.989320 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:44.989380 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:44.989515 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 18:42:44.989580 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:42:44.990618 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:44.982834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37831 (local address 127.4.61.194:54243)
0808 18:42:44.983543 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:44.983584 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:44.984910 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:44.985438 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:44.985445 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:44.985530 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:44.986022 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.986035 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.986870 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.986873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.987763 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:44.987773 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:44.988245 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:44.988250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:44.988415 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:44.989027 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:44.989028 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:44.989068 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:44.989129 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:44.989389 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:44.989398 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:44.989404 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 18:42:44.989508 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 18:42:44.989798 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":142,"threads_started":1}
I20260808 18:42:44.991745 1518 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37831
I20260808 18:42:44.992018 1518 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:44.992660 1518 heartbeater.cc:511] Master 127.4.61.254:37831 requested a full tablet report, sending...
I20260808 18:42:44.993815 1002 ts_manager.cc:194] Registered new tserver with Master: c5ba5144f2734d98be75eecfc5975069 (127.4.61.194:42581)
I20260808 18:42:44.994474 1002 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.194:54243
W20260808 18:42:45.098208 1526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:45.098529 1526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:45.098577 1526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:45.102646 1526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:45.102698 1526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:45.102763 1526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:45.107702 1526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:45463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:45.108752 1526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:45.110181 1526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:45.119566 1537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:45.119560 1534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:45.119560 1535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:45.119673 1526 server_base.cc:1034] running on GCE node
I20260808 18:42:45.120239 1526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:45.120796 1526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:45.121950 1526 hybrid_clock.cc:648] HybridClock initialized: now 1786214565121931 us; error 38 us; skew 500 ppm
I20260808 18:42:45.123620 1526 webserver.cc:460] Webserver started at http://127.4.61.195:38585/ using document root <none> and password file <none>
I20260808 18:42:45.124182 1526 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:45.124249 1526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:45.124432 1526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:45.126431 1526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "00bd5aa19698454796c4d14e0706a916"
format_stamp: "Formatted at 2026-08-08 18:42:45 on dist-test-slave-fgb3"
server_key: "0d526790c6dd2abc8a80f27fb2362d68"
server_key_iv: "485995f7d3f6b470c11a953efee9f2af"
server_key_version: "encryptionkey@0"
I20260808 18:42:45.126973 1526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "00bd5aa19698454796c4d14e0706a916"
format_stamp: "Formatted at 2026-08-08 18:42:45 on dist-test-slave-fgb3"
server_key: "0d526790c6dd2abc8a80f27fb2362d68"
server_key_iv: "485995f7d3f6b470c11a953efee9f2af"
server_key_version: "encryptionkey@0"
I20260808 18:42:45.130399 1526 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:45.132699 1545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:45.133793 1526 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:45.133908 1526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "00bd5aa19698454796c4d14e0706a916"
format_stamp: "Formatted at 2026-08-08 18:42:45 on dist-test-slave-fgb3"
server_key: "0d526790c6dd2abc8a80f27fb2362d68"
server_key_iv: "485995f7d3f6b470c11a953efee9f2af"
server_key_version: "encryptionkey@0"
I20260808 18:42:45.134001 1526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:45.157101 1526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:45.157820 1526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:45.158028 1526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:45.158712 1526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:45.159686 1526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:45.159736 1526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:45.159791 1526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:45.159816 1526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:45.168383 1526 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:34457
I20260808 18:42:45.168426 1718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:34457 every 8 connection(s)
I20260808 18:42:45.169293 1526 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:45.170682 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 1526
I20260808 18:42:45.170783 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:45.171094 4343 external_mini_cluster.cc:1428] Setting key 27784dbaecf70096a0aad855981c0742
I20260808 18:42:45.178180 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.171125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:59779 (local address 127.4.61.254:37831)
0808 18:42:45.171273 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.171278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.172608 (+ 1330us) server_negotiation.cc:407] Connection header received
0808 18:42:45.173993 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.173996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.174042 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.174107 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:45.175009 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.175536 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.176601 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.176804 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.176872 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.177802 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:45.177805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:45.177808 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:45.177819 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:45.177837 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:45.177844 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:45.177900 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.178015 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.178064 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 18:42:45.179013 1721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.171574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:37831 (local address 127.4.61.195:59779)
0808 18:42:45.172471 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.172525 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.173801 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.174267 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.174273 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.174386 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:45.174888 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.174900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.175626 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.175628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.176513 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.176522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.176912 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.176915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.177054 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.177575 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:45.177577 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:45.177615 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:45.177677 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:45.177904 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:45.177909 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:45.177912 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.178009 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.178225 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":129,"threads_started":1}
I20260808 18:42:45.180018 1719 heartbeater.cc:347] Connected to a master server at 127.4.61.254:37831
I20260808 18:42:45.180228 1719 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:45.180717 1719 heartbeater.cc:511] Master 127.4.61.254:37831 requested a full tablet report, sending...
I20260808 18:42:45.181665 1002 ts_manager.cc:194] Registered new tserver with Master: 00bd5aa19698454796c4d14e0706a916 (127.4.61.195:34457)
I20260808 18:42:45.182224 1002 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.195:59779
I20260808 18:42:45.184689 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:45.190266 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.186553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.4.61.254:37831)
0808 18:42:45.186687 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.186691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.186841 (+ 150us) server_negotiation.cc:407] Connection header received
0808 18:42:45.186970 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.186973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.187015 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.187078 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:45.187357 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.187862 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.188706 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.188915 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.189008 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.189788 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:45.189792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:45.189795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:45.189806 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:45.189824 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:45.189831 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:45.189930 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.190090 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.190128 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 18:42:45.193113 1002 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:45.196077 1002 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:45.209725 1734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.203987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42581 (local address 127.0.0.1:45140)
0808 18:42:45.204463 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.204509 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.204637 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.205434 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.205440 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.205461 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:45.205658 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.205666 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.207056 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.207060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.208108 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.208120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.209156 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.209160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.209278 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.209319 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.209439 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.209565 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":78,"threads_started":1}
I20260808 18:42:45.209764 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.204127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45140 (local address 127.4.61.194:42581)
0808 18:42:45.204740 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.204753 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.204777 (+ 24us) server_negotiation.cc:407] Connection header received
0808 18:42:45.204855 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.204861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.205091 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.205250 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:45.205898 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.206957 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.208252 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.209061 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.209162 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.209373 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.209487 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.209589 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":122,"threads_started":1}
I20260808 18:42:45.210496 1737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.204586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46415 (local address 127.0.0.1:47640)
0808 18:42:45.205595 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.205608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.205689 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.206486 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.206490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.206508 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:45.206591 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.206597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.207964 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.207967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.208956 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.208967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.210027 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.210031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.210118 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.210143 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.210221 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.210295 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":952,"thread_start_us":95,"threads_started":1}
I20260808 18:42:45.210530 1744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.205040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.4.61.193:46415)
0808 18:42:45.205333 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.205348 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.205817 (+ 469us) server_negotiation.cc:407] Connection header received
0808 18:42:45.205952 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.205959 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.206151 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.206298 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:45.206721 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.207835 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.209090 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.209864 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.209980 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.210171 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.210263 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.210382 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":95,"threads_started":1}
I20260808 18:42:45.210520 1740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.204108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:34457 (local address 127.0.0.1:42392)
0808 18:42:45.205324 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.205337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.205420 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.206242 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.206245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.206263 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:45.206370 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.206378 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.207732 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.207736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.208829 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.208840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.210085 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.210089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.210184 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.210209 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.210273 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.210371 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"mutex_wait_us":4,"thread_start_us":113,"threads_started":1}
I20260808 18:42:45.210855 1741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.204783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.4.61.195:34457)
0808 18:42:45.205659 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.205670 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.205693 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:42:45.205930 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.205936 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.206111 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.206247 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:45.206492 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.207601 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.208967 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.209726 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.209826 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.210022 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.210613 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.210710 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":153,"threads_started":1}
I20260808 18:42:45.213503 1193 tablet_service.cc:1467] Processing CreateTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 (DEFAULT_TABLE table=test-table [id=e5123c814c79425090205296dcb43b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:45.213503 1398 tablet_service.cc:1467] Processing CreateTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 (DEFAULT_TABLE table=test-table [id=e5123c814c79425090205296dcb43b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:45.213678 1630 tablet_service.cc:1467] Processing CreateTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 (DEFAULT_TABLE table=test-table [id=e5123c814c79425090205296dcb43b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:45.214660 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a421c86cf414b9395e5c8c8ec326f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:45.214663 1398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a421c86cf414b9395e5c8c8ec326f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:45.214663 1193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a421c86cf414b9395e5c8c8ec326f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:45.221802 1745 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Bootstrap starting.
I20260808 18:42:45.222610 1748 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Bootstrap starting.
I20260808 18:42:45.222671 1746 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Bootstrap starting.
I20260808 18:42:45.224188 1745 tablet_bootstrap.cc:654] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:45.224520 1748 tablet_bootstrap.cc:654] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:45.224781 1746 tablet_bootstrap.cc:654] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:45.225096 1745 log.cc:824] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:45.225222 1748 log.cc:824] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:45.225545 1746 log.cc:824] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:45.227253 1745 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: No bootstrap required, opened a new log
I20260808 18:42:45.227450 1745 ts_tablet_manager.cc:1397] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:42:45.227504 1746 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: No bootstrap required, opened a new log
I20260808 18:42:45.227523 1748 tablet_bootstrap.cc:492] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: No bootstrap required, opened a new log
I20260808 18:42:45.227674 1746 ts_tablet_manager.cc:1397] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:42:45.227723 1748 ts_tablet_manager.cc:1397] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:42:45.230731 1746 raft_consensus.cc:348] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.230957 1746 raft_consensus.cc:374] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:45.231040 1746 raft_consensus.cc:729] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ba5144f2734d98be75eecfc5975069, State: Initialized, Role: FOLLOWER
I20260808 18:42:45.231551 1746 consensus_queue.cc:260] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.231686 1748 raft_consensus.cc:348] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.231686 1745 raft_consensus.cc:348] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.231940 1745 raft_consensus.cc:374] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:45.231977 1748 raft_consensus.cc:374] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:45.232059 1748 raft_consensus.cc:729] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbf9a6c02eae4088ae88eaadb0502063, State: Initialized, Role: FOLLOWER
I20260808 18:42:45.232234 1518 heartbeater.cc:503] Master 127.4.61.254:37831 was elected leader, sending a full tablet report...
I20260808 18:42:45.232488 1746 ts_tablet_manager.cc:1428] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260808 18:42:45.232513 1748 consensus_queue.cc:260] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.233122 1300 heartbeater.cc:503] Master 127.4.61.254:37831 was elected leader, sending a full tablet report...
I20260808 18:42:45.232069 1745 raft_consensus.cc:729] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00bd5aa19698454796c4d14e0706a916, State: Initialized, Role: FOLLOWER
I20260808 18:42:45.233470 1748 ts_tablet_manager.cc:1428] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:42:45.233776 1745 consensus_queue.cc:260] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.234668 1745 ts_tablet_manager.cc:1428] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 18:42:45.235371 1719 heartbeater.cc:503] Master 127.4.61.254:37831 was elected leader, sending a full tablet report...
I20260808 18:42:45.283278 1757 raft_consensus.cc:482] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:45.283473 1757 raft_consensus.cc:504] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.284667 1757 leader_election.cc:288] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ba5144f2734d98be75eecfc5975069 (127.4.61.194:42581), fbf9a6c02eae4088ae88eaadb0502063 (127.4.61.193:46415)
W20260808 18:42:45.288079 1301 tablet.cc:2369] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:45.288194 1721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.284913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46415 (local address 127.4.61.195:48577)
0808 18:42:45.285040 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.285057 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.285162 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.285427 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.285431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.285458 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:45.285562 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.285568 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.286367 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.286370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.287186 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.287196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.287789 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.287793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.287889 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.287913 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.287988 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.288056 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":31}
I20260808 18:42:45.288252 1744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.285019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:48577 (local address 127.4.61.193:46415)
0808 18:42:45.285202 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.285206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.285223 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:42:45.285280 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.285283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.285327 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.285398 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:45.285670 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.286243 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.287304 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.287685 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.287789 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.287843 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.288035 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.288120 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 18:42:45.288872 1758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.284913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42581 (local address 127.4.61.195:56539)
0808 18:42:45.285414 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.285426 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:45.285517 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:45.285734 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:45.285737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:45.285752 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:45.285863 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.285867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.286691 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.286695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.287508 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:45.287518 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.288254 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.288257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:45.288558 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.288586 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 18:42:45.288665 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 18:42:45.288729 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":172,"thread_start_us":144,"threads_started":1}
I20260808 18:42:45.288813 1224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a421c86cf414b9395e5c8c8ec326f09" candidate_uuid: "00bd5aa19698454796c4d14e0706a916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbf9a6c02eae4088ae88eaadb0502063" is_pre_election: true
I20260808 18:42:45.288901 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.285049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:56539 (local address 127.4.61.194:42581)
0808 18:42:45.285180 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.285184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.285509 (+ 325us) server_negotiation.cc:407] Connection header received
0808 18:42:45.285603 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.285606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.285651 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.285710 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:45.285968 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.286589 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.287626 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.288027 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.288132 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.288176 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.288709 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.288794 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:45.289150 1224 raft_consensus.cc:2454] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00bd5aa19698454796c4d14e0706a916 in term 0.
I20260808 18:42:45.289495 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a421c86cf414b9395e5c8c8ec326f09" candidate_uuid: "00bd5aa19698454796c4d14e0706a916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ba5144f2734d98be75eecfc5975069" is_pre_election: true
I20260808 18:42:45.289671 1552 leader_election.cc:302] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00bd5aa19698454796c4d14e0706a916, fbf9a6c02eae4088ae88eaadb0502063; no voters:
I20260808 18:42:45.289747 1434 raft_consensus.cc:2454] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00bd5aa19698454796c4d14e0706a916 in term 0.
I20260808 18:42:45.289929 1757 raft_consensus.cc:2781] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:45.290042 1757 raft_consensus.cc:482] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:45.290078 1757 raft_consensus.cc:3037] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:45.291134 1757 raft_consensus.cc:504] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.291477 1757 leader_election.cc:288] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [CANDIDATE]: Term 1 election: Requested vote from peers c5ba5144f2734d98be75eecfc5975069 (127.4.61.194:42581), fbf9a6c02eae4088ae88eaadb0502063 (127.4.61.193:46415)
I20260808 18:42:45.291839 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a421c86cf414b9395e5c8c8ec326f09" candidate_uuid: "00bd5aa19698454796c4d14e0706a916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ba5144f2734d98be75eecfc5975069"
I20260808 18:42:45.291831 1224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a421c86cf414b9395e5c8c8ec326f09" candidate_uuid: "00bd5aa19698454796c4d14e0706a916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbf9a6c02eae4088ae88eaadb0502063"
I20260808 18:42:45.291980 1224 raft_consensus.cc:3037] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:45.291967 1434 raft_consensus.cc:3037] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:45.293273 1434 raft_consensus.cc:2454] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00bd5aa19698454796c4d14e0706a916 in term 1.
I20260808 18:42:45.293273 1224 raft_consensus.cc:2454] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00bd5aa19698454796c4d14e0706a916 in term 1.
I20260808 18:42:45.293622 1548 leader_election.cc:302] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00bd5aa19698454796c4d14e0706a916, c5ba5144f2734d98be75eecfc5975069; no voters:
I20260808 18:42:45.293804 1757 raft_consensus.cc:2781] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:45.294029 1757 raft_consensus.cc:686] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 1 LEADER]: Becoming Leader. State: Replica: 00bd5aa19698454796c4d14e0706a916, State: Running, Role: LEADER
I20260808 18:42:45.294420 1757 consensus_queue.cc:237] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } }
I20260808 18:42:45.297621 1002 catalog_manager.cc:5495] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00bd5aa19698454796c4d14e0706a916 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "00bd5aa19698454796c4d14e0706a916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00bd5aa19698454796c4d14e0706a916" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 34457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 } health_report { overall_health: UNKNOWN } } }
I20260808 18:42:45.309756 1741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.306639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.4.61.195:34457)
0808 18:42:45.306747 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:45.306750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:45.306763 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:42:45.306898 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:45.306901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:45.306958 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:45.307042 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:45.307247 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.307741 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.308534 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:45.308732 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:45.308797 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:45.309035 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:45.309440 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:45.309552 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:45.309609 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 18:42:45.309642 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 18:42:45.317893 1434 raft_consensus.cc:1261] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 1 FOLLOWER]: Refusing update from remote peer 00bd5aa19698454796c4d14e0706a916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:45.317902 1224 raft_consensus.cc:1261] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 1 FOLLOWER]: Refusing update from remote peer 00bd5aa19698454796c4d14e0706a916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:45.318637 1761 consensus_queue.cc:1035] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ba5144f2734d98be75eecfc5975069" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:45.318821 1757 consensus_queue.cc:1035] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf9a6c02eae4088ae88eaadb0502063" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:45.324973 1766 mvcc.cc:205] Tried to move back new op lower bound from 7316334859534409728 to 7316334859448811520. Current Snapshot: MvccSnapshot[applied={T|T < 7316334859534409728}]
I20260808 18:42:45.327832 1767 mvcc.cc:205] Tried to move back new op lower bound from 7316334859534409728 to 7316334859448811520. Current Snapshot: MvccSnapshot[applied={T|T < 7316334859534409728 or (T in {7316334859534409728})}]
I20260808 18:42:45.334219 1001 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:45.334404 1001 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:45.336740 1001 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5699db0200e346fc9a00e381573e4a66: Sending DeleteTablet for 3 replicas of tablet 5a421c86cf414b9395e5c8c8ec326f09
I20260808 18:42:45.337582 1630 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:45 UTC) from {username='slave'} at 127.0.0.1:42392
I20260808 18:42:45.337582 1398 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:45 UTC) from {username='slave'} at 127.0.0.1:45140
I20260808 18:42:45.337738 1193 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a421c86cf414b9395e5c8c8ec326f09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:45 UTC) from {username='slave'} at 127.0.0.1:47640
I20260808 18:42:45.338200 1785 tablet_replica.cc:330] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: stopping tablet replica
I20260808 18:42:45.338599 1785 raft_consensus.cc:2229] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:45.338490 1786 tablet_replica.cc:330] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063: stopping tablet replica
I20260808 18:42:45.339054 1785 raft_consensus.cc:2258] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:45.339165 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 1099
I20260808 18:42:45.339104 1786 raft_consensus.cc:2229] T 5a421c86cf414b9395e5c8c8ec326f09 P fbf9a6c02eae4088ae88eaadb0502063 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:45.340155 1784 tablet_replica.cc:330] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: stopping tablet replica
I20260808 18:42:45.340523 1784 raft_consensus.cc:2229] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:45.340905 1784 raft_consensus.cc:2258] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:45.352137 1784 ts_tablet_manager.cc:1905] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:45.352602 1785 ts_tablet_manager.cc:1905] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:45.355139 1784 ts_tablet_manager.cc:1918] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:45.355278 1784 log.cc:1196] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/5a421c86cf414b9395e5c8c8ec326f09
I20260808 18:42:45.355376 1785 ts_tablet_manager.cc:1918] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:45.355640 1785 log.cc:1196] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/5a421c86cf414b9395e5c8c8ec326f09
I20260808 18:42:45.355640 1784 ts_tablet_manager.cc:1939] T 5a421c86cf414b9395e5c8c8ec326f09 P c5ba5144f2734d98be75eecfc5975069: Deleting consensus metadata
I20260808 18:42:45.356001 1785 ts_tablet_manager.cc:1939] T 5a421c86cf414b9395e5c8c8ec326f09 P 00bd5aa19698454796c4d14e0706a916: Deleting consensus metadata
I20260808 18:42:45.357004 978 catalog_manager.cc:4841] TS c5ba5144f2734d98be75eecfc5975069 (127.4.61.194:42581): tablet 5a421c86cf414b9395e5c8c8ec326f09 (table test-table [id=e5123c814c79425090205296dcb43b88]) successfully deleted
I20260808 18:42:45.357164 983 catalog_manager.cc:4841] TS 00bd5aa19698454796c4d14e0706a916 (127.4.61.195:34457): tablet 5a421c86cf414b9395e5c8c8ec326f09 (table test-table [id=e5123c814c79425090205296dcb43b88]) successfully deleted
W20260808 18:42:45.358496 984 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:46415 (error 108)
I20260808 18:42:45.359483 1737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:45.359196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:46415 (local address 127.0.0.1:47654)
0808 18:42:45.359316 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:45.359385 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 18:42:45.359628 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 1304
W20260808 18:42:45.359686 984 catalog_manager.cc:4584] TS fbf9a6c02eae4088ae88eaadb0502063 (127.4.61.193:46415): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5a421c86cf414b9395e5c8c8ec326f09: Network error: Client connection negotiation failed: client connection to 127.4.61.193:46415: connect: Connection refused (error 111)
I20260808 18:42:45.388276 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 1526
I20260808 18:42:45.402750 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 953
2026-08-08T18:42:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1082 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:45 dist-test-slave-fgb3 krb5kdc[1794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:45 dist-test-slave-fgb3 krb5kdc[1794](info): set up 2 sockets
Aug 08 18:42:45 dist-test-slave-fgb3 krb5kdc[1794](info): commencing operation
krb5kdc: starting...
W20260808 18:42:46.536118 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:46 dist-test-slave-fgb3 krb5kdc[1794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:42:46.654915 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43621
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:43621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:46.764684 1817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:46.764973 1817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:46.765027 1817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:46.768994 1817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:46.769064 1817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:46.769089 1817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:46.769109 1817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:46.769129 1817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:46.774499 1817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:43621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:46.775633 1817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:46.776690 1817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:46.785373 1828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:46.785373 1826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:46.785390 1825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:46.785429 1817 server_base.cc:1034] running on GCE node
I20260808 18:42:46.786214 1817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:46.787349 1817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:46.788518 1817 hybrid_clock.cc:648] HybridClock initialized: now 1786214566788503 us; error 30 us; skew 500 ppm
Aug 08 18:42:46 dist-test-slave-fgb3 krb5kdc[1794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214566, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:46.791258 1817 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:42:46.792191 1817 webserver.cc:460] Webserver started at http://127.4.61.254:34129/ using document root <none> and password file <none>
I20260808 18:42:46.792739 1817 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:46.792802 1817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:46.793064 1817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:46.795228 1817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "0acf346fef874a239e466a3750078b70"
format_stamp: "Formatted at 2026-08-08 18:42:46 on dist-test-slave-fgb3"
server_key: "998d9cbf81459e32eea2631df029b312"
server_key_iv: "bfd0d5bfa72a3dffad51d65c05d05bfe"
server_key_version: "encryptionkey@0"
I20260808 18:42:46.795794 1817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "0acf346fef874a239e466a3750078b70"
format_stamp: "Formatted at 2026-08-08 18:42:46 on dist-test-slave-fgb3"
server_key: "998d9cbf81459e32eea2631df029b312"
server_key_iv: "bfd0d5bfa72a3dffad51d65c05d05bfe"
server_key_version: "encryptionkey@0"
I20260808 18:42:46.799593 1817 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:42:46.802377 1837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:46.803825 1817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:46.803962 1817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "0acf346fef874a239e466a3750078b70"
format_stamp: "Formatted at 2026-08-08 18:42:46 on dist-test-slave-fgb3"
server_key: "998d9cbf81459e32eea2631df029b312"
server_key_iv: "bfd0d5bfa72a3dffad51d65c05d05bfe"
server_key_version: "encryptionkey@0"
I20260808 18:42:46.804090 1817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:46.817330 1817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:46.820344 1817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:46.820526 1817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:46.827631 1817 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:43621
I20260808 18:42:46.827646 1911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:43621 every 8 connection(s)
I20260808 18:42:46.828617 1817 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:46.830618 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 1817
I20260808 18:42:46.830777 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:46.831076 4343 external_mini_cluster.cc:1428] Setting key b3a7b695ab6fb418c4884937da039938
I20260808 18:42:46.831511 1912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:46.838349 1912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: Bootstrap starting.
Aug 08 18:42:46 dist-test-slave-fgb3 krb5kdc[1794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:46.841023 1912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:46.841885 1912 log.cc:824] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:46.843936 1912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: No bootstrap required, opened a new log
I20260808 18:42:46.845655 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:46.832454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.4.61.254:43621)
0808 18:42:46.832901 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:46.832919 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:46.832957 (+ 38us) server_negotiation.cc:407] Connection header received
0808 18:42:46.833634 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:46.833652 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:46.833981 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:46.834283 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:46.835296 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:46.836306 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:46.837519 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:46.838026 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:46.838166 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:46.840882 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:46.840887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:46.840901 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:46.840931 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:46.842658 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:46.843082 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:46.843087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:46.843092 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:46.843204 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:46.843491 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:46.843494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:46.843495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:46.843925 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:46.844118 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:46.844418 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 18:42:46.844714 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":131,"threads_started":1}
I20260808 18:42:46.847215 1912 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } }
I20260808 18:42:46.847507 1912 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:46.847568 1912 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0acf346fef874a239e466a3750078b70, State: Initialized, Role: FOLLOWER
I20260808 18:42:46.847999 1912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } }
I20260808 18:42:46.848155 1912 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:46.848204 1912 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:46.848277 1912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:46.849148 1912 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } }
I20260808 18:42:46.849506 1912 leader_election.cc:302] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0acf346fef874a239e466a3750078b70; no voters:
I20260808 18:42:46.849858 1912 leader_election.cc:288] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:46.849923 1925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:46.850122 1925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [term 1 LEADER]: Becoming Leader. State: Replica: 0acf346fef874a239e466a3750078b70, State: Running, Role: LEADER
I20260808 18:42:46.850445 1925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } }
I20260808 18:42:46.851181 1912 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:46.852192 1927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0acf346fef874a239e466a3750078b70. Latest consensus state: current_term: 1 leader_uuid: "0acf346fef874a239e466a3750078b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } } }
I20260808 18:42:46.852367 1927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:46.852710 1926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0acf346fef874a239e466a3750078b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0acf346fef874a239e466a3750078b70" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43621 } } }
I20260808 18:42:46.852779 1935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:46.852867 1926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:46.855614 1935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:46.861169 1935 catalog_manager.cc:1347] Generated new cluster ID: 1a617c976f6c4c0aadfb892b86475d7a
I20260808 18:42:46.861228 1935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:46.885922 1935 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:46.887015 1935 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:46.893406 1935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: Generated new TSK 0
I20260808 18:42:46.894371 1935 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.61.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
Entry for principal kudu/127.4.61.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab.
I20260808 18:42:46.931066 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:47.042843 1950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:47.043084 1950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:47.043124 1950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:47.047024 1950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:47.047071 1950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:47.047129 1950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:47.052127 1950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.193.keytab
--principal=kudu/127.4.61.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:47.053131 1950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:47.054085 1950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:47.063184 1956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:47.063192 1957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:47.063346 1959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:47.063597 1950 server_base.cc:1034] running on GCE node
I20260808 18:42:47.063992 1950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:47.064589 1950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:47.065773 1950 hybrid_clock.cc:648] HybridClock initialized: now 1786214567065753 us; error 26 us; skew 500 ppm
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:47.068495 1950 init.cc:377] Logged in from keytab as kudu/127.4.61.193@KRBTEST.COM (short username kudu)
I20260808 18:42:47.069295 1950 webserver.cc:460] Webserver started at http://127.4.61.193:46629/ using document root <none> and password file <none>
I20260808 18:42:47.069788 1950 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:47.069844 1950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:47.070009 1950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:47.071962 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "24366c9aae63486c89e2758e51aba9f5"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "f88508a06ce76f8668058aa8ec2a64bf"
server_key_iv: "50a90c8f86dd0b80a85ff3fd542b5b51"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.072491 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "24366c9aae63486c89e2758e51aba9f5"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "f88508a06ce76f8668058aa8ec2a64bf"
server_key_iv: "50a90c8f86dd0b80a85ff3fd542b5b51"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.075980 1950 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 18:42:47.078208 1972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.079406 1950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:42:47.079514 1950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "24366c9aae63486c89e2758e51aba9f5"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "f88508a06ce76f8668058aa8ec2a64bf"
server_key_iv: "50a90c8f86dd0b80a85ff3fd542b5b51"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.079602 1950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:47.090036 1950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:47.093082 1950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:47.093269 1950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:47.093832 1950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:47.094719 1950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:47.094774 1950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.094832 1950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:47.094867 1950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.103995 1950 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:37671
I20260808 18:42:47.104043 2144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:37671 every 8 connection(s)
I20260808 18:42:47.104955 1950 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:47.108394 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 1950
I20260808 18:42:47.108537 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:47.108868 4343 external_mini_cluster.cc:1428] Setting key d2af228a46cd45ac422fa082c6004e95
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.193@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:47.119354 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.106879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:56663 (local address 127.4.61.254:43621)
0808 18:42:47.107003 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.107007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.107869 (+ 862us) server_negotiation.cc:407] Connection header received
0808 18:42:47.109074 (+ 1205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.109077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.109132 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.109203 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:47.110748 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.111525 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.112687 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.112930 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.113021 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.115665 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:47.115668 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:47.115670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:47.115695 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:47.117153 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.117685 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.117690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.117692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.117789 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.118158 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.118162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.118164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.118439 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:47.118548 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.119027 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.119167 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:42:47.120071 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.107191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43621 (local address 127.4.61.193:56663)
0808 18:42:47.107699 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.107742 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.108811 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.109396 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.109402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.109852 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:47.110576 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.110599 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.111660 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.111663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.112561 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.112571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.113073 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.113077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.113237 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.113786 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:47.113803 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:47.115490 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:47.117268 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.117274 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.117286 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.117570 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.117897 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.117900 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.117902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.118062 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.118551 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:47.118556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:47.118788 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.118954 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.119207 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":126,"threads_started":1}
WARNING: no policy specified for kudu/127.4.61.194@KRBTEST.COM; defaulting to no policy
I20260808 18:42:47.121232 2146 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43621
I20260808 18:42:47.121484 2146 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:47.121975 2146 heartbeater.cc:511] Master 127.4.61.254:43621 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.194@KRBTEST.COM" created.
I20260808 18:42:47.123572 1856 ts_manager.cc:194] Registered new tserver with Master: 24366c9aae63486c89e2758e51aba9f5 (127.4.61.193:37671)
I20260808 18:42:47.124709 1856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.193@KRBTEST.COM'} at 127.4.61.193:56663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
Entry for principal kudu/127.4.61.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab.
I20260808 18:42:47.139328 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:47.249550 2152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:47.249826 2152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:47.249871 2152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:47.254045 2152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:47.254114 2152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:47.254177 2152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:47.259500 2152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.194.keytab
--principal=kudu/127.4.61.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:47.260561 2152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:47.261572 2152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:47.271080 2164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:47.271093 2169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:47.271095 2157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:47.271319 2152 server_base.cc:1034] running on GCE node
I20260808 18:42:47.271782 2152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:47.272405 2152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:47.273563 2152 hybrid_clock.cc:648] HybridClock initialized: now 1786214567273544 us; error 30 us; skew 500 ppm
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:47.276247 2152 init.cc:377] Logged in from keytab as kudu/127.4.61.194@KRBTEST.COM (short username kudu)
I20260808 18:42:47.277115 2152 webserver.cc:460] Webserver started at http://127.4.61.194:44705/ using document root <none> and password file <none>
I20260808 18:42:47.277700 2152 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:47.277765 2152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:47.277992 2152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:47.280102 2152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "427cd1ed9ced475296360c6250cff83e"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "dcbb431b01ab8258491f0c00d69f8c05"
server_key_iv: "735543abda89b6d89d5e1db11429c5cd"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.280653 2152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "427cd1ed9ced475296360c6250cff83e"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "dcbb431b01ab8258491f0c00d69f8c05"
server_key_iv: "735543abda89b6d89d5e1db11429c5cd"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.284397 2152 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:42:47.286787 2177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.287988 2152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:47.288089 2152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "427cd1ed9ced475296360c6250cff83e"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "dcbb431b01ab8258491f0c00d69f8c05"
server_key_iv: "735543abda89b6d89d5e1db11429c5cd"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.288190 2152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:47.299476 2152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:47.302662 2152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:47.302846 2152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:47.303449 2152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:47.304291 2152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:47.304348 2152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.304406 2152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:47.304436 2152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.313791 2152 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:34011
I20260808 18:42:47.313867 2338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:34011 every 8 connection(s)
I20260808 18:42:47.314998 2152 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:47.315426 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 2152
I20260808 18:42:47.315575 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:47.315945 4343 external_mini_cluster.cc:1428] Setting key f69169312b81a8726335262afcb5a62f
WARNING: no policy specified for kudu/127.4.61.195@KRBTEST.COM; defaulting to no policy
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.194@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.195@KRBTEST.COM" created.
I20260808 18:42:47.331796 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.318115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:59031 (local address 127.4.61.254:43621)
0808 18:42:47.318271 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.318275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.319798 (+ 1523us) server_negotiation.cc:407] Connection header received
0808 18:42:47.321615 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.321619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.321679 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.321771 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:47.323374 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.323984 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.325138 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.325367 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.325464 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.328091 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:47.328094 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:47.328096 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:47.328122 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:47.329634 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.330105 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.330107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.330108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.330185 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.330627 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.330629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.330630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.330836 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:47.330923 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.331471 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.331610 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 18:42:47.332631 2342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.319106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43621 (local address 127.4.61.194:59031)
0808 18:42:47.319643 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.319700 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.321319 (+ 1619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.322076 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.322087 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.322644 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:47.323227 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.323243 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.324124 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.324128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.325021 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.325031 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.325520 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.325524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.325702 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.326365 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:47.326387 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:47.327916 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:47.329733 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.329738 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.329752 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.330017 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.330366 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.330370 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.330372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.330525 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.330941 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:47.330948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:47.331212 (+ 264us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.331394 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.331742 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":157,"threads_started":1}
I20260808 18:42:47.333882 2339 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43621
I20260808 18:42:47.334154 2339 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:47.334786 2339 heartbeater.cc:511] Master 127.4.61.254:43621 requested a full tablet report, sending...
I20260808 18:42:47.336026 1856 ts_manager.cc:194] Registered new tserver with Master: 427cd1ed9ced475296360c6250cff83e (127.4.61.194:34011)
I20260808 18:42:47.336616 1856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.194@KRBTEST.COM'} at 127.4.61.194:59031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
Entry for principal kudu/127.4.61.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab.
I20260808 18:42:47.347077 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:37281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:47.460489 2347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:47.460783 2347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:47.460850 2347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:47.464888 2347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:47.464956 2347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:47.465039 2347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:47.470422 2347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:37281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.195.keytab
--principal=kudu/127.4.61.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:43621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:47.471518 2347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:47.472548 2347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:47.481878 2361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:47.481878 2357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:47.482041 2347 server_base.cc:1034] running on GCE node
W20260808 18:42:47.481932 2356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:47.482535 2347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:47.483176 2347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:47.484345 2347 hybrid_clock.cc:648] HybridClock initialized: now 1786214567484328 us; error 31 us; skew 500 ppm
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:47.486928 2347 init.cc:377] Logged in from keytab as kudu/127.4.61.195@KRBTEST.COM (short username kudu)
I20260808 18:42:47.487761 2347 webserver.cc:460] Webserver started at http://127.4.61.195:44457/ using document root <none> and password file <none>
I20260808 18:42:47.488288 2347 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:47.488354 2347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:47.488547 2347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:47.490623 2347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "db34f074cf0d422982e05b6006a88f67"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "e6656ad3efd07ac1b0850cddcff32d60"
server_key_iv: "96f83e3ea39decdebb0168b6c08d1bf5"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.491195 2347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "db34f074cf0d422982e05b6006a88f67"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "e6656ad3efd07ac1b0850cddcff32d60"
server_key_iv: "96f83e3ea39decdebb0168b6c08d1bf5"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.495087 2347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 18:42:47.497545 2370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.498802 2347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:42:47.498914 2347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "db34f074cf0d422982e05b6006a88f67"
format_stamp: "Formatted at 2026-08-08 18:42:47 on dist-test-slave-fgb3"
server_key: "e6656ad3efd07ac1b0850cddcff32d60"
server_key_iv: "96f83e3ea39decdebb0168b6c08d1bf5"
server_key_version: "encryptionkey@0"
I20260808 18:42:47.499012 2347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:47.509526 2347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:47.512493 2347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:47.512672 2347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:47.513250 2347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:47.514079 2347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:47.514130 2347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.514184 2347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:47.514210 2347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:47.522646 2347 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:36853
I20260808 18:42:47.522678 2541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:36853 every 8 connection(s)
I20260808 18:42:47.523547 2347 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:47.524060 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 2347
I20260808 18:42:47.524257 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:47.524564 4343 external_mini_cluster.cc:1428] Setting key cc4f40f9c5fa50eb9aaf26f7e5d9074a
Aug 08 18:42:47 dist-test-slave-fgb3 krb5kdc[1794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214567, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.195@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:42:47.536912 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.525489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:33721 (local address 127.4.61.254:43621)
0808 18:42:47.525614 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.525618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.526638 (+ 1020us) server_negotiation.cc:407] Connection header received
0808 18:42:47.528104 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.528108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.528165 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.528239 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:47.529447 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.529984 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.531179 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.531416 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.531503 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.533782 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:47.533785 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:47.533787 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:47.533812 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:47.535018 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.535483 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.535486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.535488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.535563 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.535871 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.535874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.535876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.536055 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:47.536138 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.536622 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.536745 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:42:47.537683 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.526005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:43621 (local address 127.4.61.195:33721)
0808 18:42:47.526504 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.526548 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.527869 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.528440 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.528446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.528802 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:47.529305 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.529319 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.530099 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.530102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.531062 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.531073 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.531553 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.531557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.531719 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.532242 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:42:47.532257 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:47.533626 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:47.535123 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.535129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.535144 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.535389 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.535646 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:42:47.535649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:42:47.535651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:42:47.535783 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:42:47.536156 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:47.536162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:47.536400 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.536565 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.536876 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":136,"threads_started":1}
I20260808 18:42:47.538790 2543 heartbeater.cc:347] Connected to a master server at 127.4.61.254:43621
I20260808 18:42:47.539048 2543 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:47.539512 2543 heartbeater.cc:511] Master 127.4.61.254:43621 requested a full tablet report, sending...
I20260808 18:42:47.540468 1856 ts_manager.cc:194] Registered new tserver with Master: db34f074cf0d422982e05b6006a88f67 (127.4.61.195:36853)
I20260808 18:42:47.541002 1856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.61.195@KRBTEST.COM'} at 127.4.61.195:33721
I20260808 18:42:47.550796 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:47.559397 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.552788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.4.61.254:43621)
0808 18:42:47.552916 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.552921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.553100 (+ 179us) server_negotiation.cc:407] Connection header received
0808 18:42:47.553189 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.553192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.553231 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.553292 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:47.553928 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.554494 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.555306 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.555512 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.555575 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.556817 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:47.556820 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:47.556822 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:47.556838 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:47.557934 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.558309 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.558335 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.558337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.558429 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:47.558636 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:47.558638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:47.558639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:47.558838 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:47.558934 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.559172 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.559259 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:42:47.562041 1856 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:47.565042 1856 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:47.579375 2561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.573366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:34011 (local address 127.0.0.1:43304)
0808 18:42:47.574591 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.574605 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.574695 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.575209 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.575212 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.575230 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:47.575324 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.575330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.576784 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.576787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.578049 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.578059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.579008 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.579010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.579086 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.579116 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.579184 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.579263 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1170,"mutex_wait_us":133,"thread_start_us":104,"threads_started":1}
I20260808 18:42:47.579489 2566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.574108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43304 (local address 127.4.61.194:34011)
0808 18:42:47.574814 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.574824 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.574843 (+ 19us) server_negotiation.cc:407] Connection header received
0808 18:42:47.574904 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.574908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.575054 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.575199 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:47.575458 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.576628 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.578167 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.578903 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.579011 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.579167 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.579244 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.579334 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":139,"threads_started":1}
I20260808 18:42:47.580698 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.574108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38634 (local address 127.4.61.195:36853)
0808 18:42:47.574592 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.574604 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.575383 (+ 779us) server_negotiation.cc:407] Connection header received
0808 18:42:47.575530 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.575535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.575662 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.575781 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:47.576019 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.576885 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.578551 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.579351 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.579454 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.579597 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.580449 (+ 852us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.580547 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":149,"threads_started":1}
I20260808 18:42:47.581019 2565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.573302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37671 (local address 127.0.0.1:38104)
0808 18:42:47.574193 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.574245 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.574387 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.575101 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.575108 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.575131 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:47.575275 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.575283 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.576784 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.576787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.578425 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.578437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.580667 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.580670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.580748 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.580773 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.580841 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.580905 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":215,"thread_start_us":88,"threads_started":1}
I20260808 18:42:47.581176 2560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.573593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:36853 (local address 127.0.0.1:38634)
0808 18:42:47.575287 (+ 1694us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.575301 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.575382 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.575780 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.575782 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.575798 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:47.575909 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.575916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.577025 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.577028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.578425 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.578437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.579992 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.580001 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.580101 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.580312 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.580935 (+ 623us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.581016 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1636,"mutex_wait_us":22,"thread_start_us":85,"threads_started":1}
I20260808 18:42:47.581427 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.573447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38104 (local address 127.4.61.193:37671)
0808 18:42:47.574703 (+ 1256us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.574712 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.574730 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:42:47.574791 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.574795 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.574955 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.575065 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:47.575420 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.576628 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.579661 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.580381 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.580481 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.580611 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.581186 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.581279 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1170,"thread_start_us":151,"threads_started":1}
I20260808 18:42:47.582661 2244 tablet_service.cc:1467] Processing CreateTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 (DEFAULT_TABLE table=test-table [id=2c71e9118f94453f99062dfb8abd4203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:47.583673 2244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b147de2c8d8946e5a522a6a509e9ac91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:47.583957 2449 tablet_service.cc:1467] Processing CreateTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 (DEFAULT_TABLE table=test-table [id=2c71e9118f94453f99062dfb8abd4203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:47.585007 2449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b147de2c8d8946e5a522a6a509e9ac91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:47.585148 2041 tablet_service.cc:1467] Processing CreateTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 (DEFAULT_TABLE table=test-table [id=2c71e9118f94453f99062dfb8abd4203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:47.586098 2041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b147de2c8d8946e5a522a6a509e9ac91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:47.589591 2568 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Bootstrap starting.
I20260808 18:42:47.591811 2568 tablet_bootstrap.cc:654] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:47.592113 2569 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Bootstrap starting.
I20260808 18:42:47.592998 2570 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Bootstrap starting.
I20260808 18:42:47.593665 2568 log.cc:824] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:47.594871 2569 tablet_bootstrap.cc:654] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:47.595006 2570 tablet_bootstrap.cc:654] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:47.595873 2568 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: No bootstrap required, opened a new log
I20260808 18:42:47.595937 2570 log.cc:824] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:47.596091 2568 ts_tablet_manager.cc:1397] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 18:42:47.596117 2569 log.cc:824] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:47.597497 2570 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: No bootstrap required, opened a new log
I20260808 18:42:47.597667 2570 ts_tablet_manager.cc:1397] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 18:42:47.599294 2568 raft_consensus.cc:348] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.599581 2568 raft_consensus.cc:374] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:47.599642 2568 raft_consensus.cc:729] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 427cd1ed9ced475296360c6250cff83e, State: Initialized, Role: FOLLOWER
I20260808 18:42:47.599928 2569 tablet_bootstrap.cc:492] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: No bootstrap required, opened a new log
I20260808 18:42:47.600101 2569 ts_tablet_manager.cc:1397] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260808 18:42:47.600126 2568 consensus_queue.cc:260] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.600802 2339 heartbeater.cc:503] Master 127.4.61.254:43621 was elected leader, sending a full tablet report...
I20260808 18:42:47.601184 2568 ts_tablet_manager.cc:1428] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:42:47.601039 2570 raft_consensus.cc:348] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.601284 2570 raft_consensus.cc:374] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:47.601353 2570 raft_consensus.cc:729] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24366c9aae63486c89e2758e51aba9f5, State: Initialized, Role: FOLLOWER
I20260808 18:42:47.601768 2570 consensus_queue.cc:260] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.602417 2146 heartbeater.cc:503] Master 127.4.61.254:43621 was elected leader, sending a full tablet report...
I20260808 18:42:47.602797 2570 ts_tablet_manager.cc:1428] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 18:42:47.603915 2569 raft_consensus.cc:348] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.604197 2569 raft_consensus.cc:374] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:47.604259 2569 raft_consensus.cc:729] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db34f074cf0d422982e05b6006a88f67, State: Initialized, Role: FOLLOWER
I20260808 18:42:47.604676 2569 consensus_queue.cc:260] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.605314 2543 heartbeater.cc:503] Master 127.4.61.254:43621 was elected leader, sending a full tablet report...
I20260808 18:42:47.605687 2569 ts_tablet_manager.cc:1428] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260808 18:42:47.606040 2147 tablet.cc:2369] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 18:42:47.774586 2545 tablet.cc:2369] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:47.809362 2580 raft_consensus.cc:482] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:47.809587 2580 raft_consensus.cc:504] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.810969 2580 leader_election.cc:288] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24366c9aae63486c89e2758e51aba9f5 (127.4.61.193:37671), 427cd1ed9ced475296360c6250cff83e (127.4.61.194:34011)
I20260808 18:42:47.814472 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.811314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:56751 (local address 127.4.61.193:37671)
0808 18:42:47.811428 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.811433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.811448 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:42:47.811604 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.811607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.811652 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.811714 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:47.811993 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.812492 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.813526 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.813925 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.814030 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.814090 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.814260 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.814373 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:42:47.814472 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.811213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37671 (local address 127.4.61.195:56751)
0808 18:42:47.811328 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.811343 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.811463 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.811747 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.811750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.811769 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:47.811878 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.811884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.812598 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.812602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.813394 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.813403 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.814030 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.814034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.814147 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.814166 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.814231 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.814309 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 18:42:47.814769 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.811220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:34011 (local address 127.4.61.195:45711)
0808 18:42:47.811732 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.811744 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:47.811853 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:47.812081 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:47.812084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:47.812099 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:47.812211 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.812216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.812916 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.812920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.813710 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:47.813719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.814360 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.814364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:47.814459 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.814482 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:42:47.814544 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 18:42:47.814612 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":120,"thread_start_us":107,"threads_started":1}
I20260808 18:42:47.814882 2566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.811347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:45711 (local address 127.4.61.194:34011)
0808 18:42:47.811474 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.811479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.811826 (+ 347us) server_negotiation.cc:407] Connection header received
0808 18:42:47.811961 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.811963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.812007 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.812065 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:47.812329 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.812812 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.813827 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.814225 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.814355 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.814407 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.814688 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.814776 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:47.815213 2072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b147de2c8d8946e5a522a6a509e9ac91" candidate_uuid: "db34f074cf0d422982e05b6006a88f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24366c9aae63486c89e2758e51aba9f5" is_pre_election: true
I20260808 18:42:47.815410 2271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b147de2c8d8946e5a522a6a509e9ac91" candidate_uuid: "db34f074cf0d422982e05b6006a88f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "427cd1ed9ced475296360c6250cff83e" is_pre_election: true
I20260808 18:42:47.815508 2072 raft_consensus.cc:2454] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db34f074cf0d422982e05b6006a88f67 in term 0.
I20260808 18:42:47.815698 2271 raft_consensus.cc:2454] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db34f074cf0d422982e05b6006a88f67 in term 0.
I20260808 18:42:47.816012 2373 leader_election.cc:302] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24366c9aae63486c89e2758e51aba9f5, db34f074cf0d422982e05b6006a88f67; no voters:
I20260808 18:42:47.816280 2580 raft_consensus.cc:2781] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:47.816362 2580 raft_consensus.cc:482] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:47.816392 2580 raft_consensus.cc:3037] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 0 FOLLOWER]: Advancing to term 1
W20260808 18:42:47.817186 2340 tablet.cc:2369] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:47.817492 2580 raft_consensus.cc:504] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.817836 2580 leader_election.cc:288] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [CANDIDATE]: Term 1 election: Requested vote from peers 24366c9aae63486c89e2758e51aba9f5 (127.4.61.193:37671), 427cd1ed9ced475296360c6250cff83e (127.4.61.194:34011)
I20260808 18:42:47.818183 2271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b147de2c8d8946e5a522a6a509e9ac91" candidate_uuid: "db34f074cf0d422982e05b6006a88f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "427cd1ed9ced475296360c6250cff83e"
I20260808 18:42:47.818197 2072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b147de2c8d8946e5a522a6a509e9ac91" candidate_uuid: "db34f074cf0d422982e05b6006a88f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24366c9aae63486c89e2758e51aba9f5"
I20260808 18:42:47.818293 2271 raft_consensus.cc:3037] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:47.818305 2072 raft_consensus.cc:3037] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:47.819298 2271 raft_consensus.cc:2454] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db34f074cf0d422982e05b6006a88f67 in term 1.
I20260808 18:42:47.819358 2072 raft_consensus.cc:2454] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db34f074cf0d422982e05b6006a88f67 in term 1.
I20260808 18:42:47.819598 2374 leader_election.cc:302] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 427cd1ed9ced475296360c6250cff83e, db34f074cf0d422982e05b6006a88f67; no voters:
I20260808 18:42:47.819747 2580 raft_consensus.cc:2781] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:47.819960 2580 raft_consensus.cc:686] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 1 LEADER]: Becoming Leader. State: Replica: db34f074cf0d422982e05b6006a88f67, State: Running, Role: LEADER
I20260808 18:42:47.820284 2580 consensus_queue.cc:237] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } }
I20260808 18:42:47.823239 1853 catalog_manager.cc:5495] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to db34f074cf0d422982e05b6006a88f67 (127.4.61.195). New cstate: current_term: 1 leader_uuid: "db34f074cf0d422982e05b6006a88f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db34f074cf0d422982e05b6006a88f67" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 36853 } health_report { overall_health: HEALTHY } } }
I20260808 18:42:47.883033 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.879495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38642 (local address 127.4.61.195:36853)
0808 18:42:47.879643 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:47.879647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:47.879662 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:42:47.879752 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:47.879755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:47.879817 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:47.879928 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:47.880160 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.880687 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.881521 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:47.881754 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:47.881844 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:47.882073 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:47.882613 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:47.882723 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:47.882798 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 18:42:47.882865 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 18:42:47.889160 2271 raft_consensus.cc:1261] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 1 FOLLOWER]: Refusing update from remote peer db34f074cf0d422982e05b6006a88f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:47.889160 2072 raft_consensus.cc:1261] T b147de2c8d8946e5a522a6a509e9ac91 P 24366c9aae63486c89e2758e51aba9f5 [term 1 FOLLOWER]: Refusing update from remote peer db34f074cf0d422982e05b6006a88f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:47.889943 2583 consensus_queue.cc:1035] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "427cd1ed9ced475296360c6250cff83e" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:47.890130 2580 consensus_queue.cc:1035] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24366c9aae63486c89e2758e51aba9f5" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:47.898378 2589 mvcc.cc:205] Tried to move back new op lower bound from 7316334870066356224 to 7316334869794263040. Current Snapshot: MvccSnapshot[applied={T|T < 7316334870066356224}]
I20260808 18:42:47.900863 2591 mvcc.cc:205] Tried to move back new op lower bound from 7316334870066356224 to 7316334869794263040. Current Snapshot: MvccSnapshot[applied={T|T < 7316334870066356224 or (T in {7316334870066356224})}]
I20260808 18:42:47.901166 2590 mvcc.cc:205] Tried to move back new op lower bound from 7316334870066356224 to 7316334869794263040. Current Snapshot: MvccSnapshot[applied={T|T < 7316334870066356224}]
I20260808 18:42:47.907562 1853 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:47.907773 1853 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:47.910452 1853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0acf346fef874a239e466a3750078b70: Sending DeleteTablet for 3 replicas of tablet b147de2c8d8946e5a522a6a509e9ac91
I20260808 18:42:47.911268 2449 tablet_service.cc:1514] Processing DeleteTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:47 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:38634
I20260808 18:42:47.911259 2244 tablet_service.cc:1514] Processing DeleteTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:47 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:43304
I20260808 18:42:47.911294 2041 tablet_service.cc:1514] Processing DeleteTablet for tablet b147de2c8d8946e5a522a6a509e9ac91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:47 UTC) from {username='kudu', principal='kudu/127.4.61.254@KRBTEST.COM'} at 127.0.0.1:38104
I20260808 18:42:47.911877 2600 tablet_replica.cc:330] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: stopping tablet replica
I20260808 18:42:47.912122 2602 tablet_replica.cc:330] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: stopping tablet replica
I20260808 18:42:47.912493 2602 raft_consensus.cc:2229] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:47.912814 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 1950
I20260808 18:42:47.912910 2602 raft_consensus.cc:2258] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:47.913551 2600 raft_consensus.cc:2229] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:47.913975 2600 raft_consensus.cc:2258] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:47.916875 2600 ts_tablet_manager.cc:1905] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:47.919924 2600 ts_tablet_manager.cc:1918] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:47.920015 2600 log.cc:1196] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/b147de2c8d8946e5a522a6a509e9ac91
I20260808 18:42:47.921576 2602 ts_tablet_manager.cc:1905] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:47.924412 2602 ts_tablet_manager.cc:1918] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:47.924517 2602 log.cc:1196] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/b147de2c8d8946e5a522a6a509e9ac91
I20260808 18:42:47.924844 2602 ts_tablet_manager.cc:1939] T b147de2c8d8946e5a522a6a509e9ac91 P db34f074cf0d422982e05b6006a88f67: Deleting consensus metadata
I20260808 18:42:47.926047 2600 ts_tablet_manager.cc:1939] T b147de2c8d8946e5a522a6a509e9ac91 P 427cd1ed9ced475296360c6250cff83e: Deleting consensus metadata
I20260808 18:42:47.926198 1839 catalog_manager.cc:4841] TS db34f074cf0d422982e05b6006a88f67 (127.4.61.195:36853): tablet b147de2c8d8946e5a522a6a509e9ac91 (table test-table [id=2c71e9118f94453f99062dfb8abd4203]) successfully deleted
I20260808 18:42:47.927337 1842 catalog_manager.cc:4841] TS 427cd1ed9ced475296360c6250cff83e (127.4.61.194:34011): tablet b147de2c8d8946e5a522a6a509e9ac91 (table test-table [id=2c71e9118f94453f99062dfb8abd4203]) successfully deleted
W20260808 18:42:47.930387 1841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:37671 (error 108)
I20260808 18:42:47.930532 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 2152
I20260808 18:42:47.935480 2560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:47.935119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:37671 (local address 127.0.0.1:38112)
0808 18:42:47.935308 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:47.935379 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260808 18:42:47.935657 1841 catalog_manager.cc:4584] TS 24366c9aae63486c89e2758e51aba9f5 (127.4.61.193:37671): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b147de2c8d8946e5a522a6a509e9ac91: Network error: Client connection negotiation failed: client connection to 127.4.61.193:37671: connect: Connection refused (error 111)
I20260808 18:42:47.943105 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 2347
I20260808 18:42:47.953279 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 1817
2026-08-08T18:42:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2551 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T18:42:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:47Z Disabled control of system clock
I20260808 18:42:47.989015 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42023
--webserver_interface=127.4.61.254
--webserver_port=0
--builtin_ntp_servers=127.4.61.212:42773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:42023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:48.099651 2609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:48.099936 2609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:48.099973 2609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:48.104022 2609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:48.104084 2609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:48.104097 2609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:48.104112 2609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:48.104126 2609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:48.108901 2609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:42023
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:42023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:48.109949 2609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:48.111330 2609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:48.119897 2617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.119875 2622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.119926 2618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:48.119951 2609 server_base.cc:1034] running on GCE node
I20260808 18:42:48.120729 2609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:48.121788 2609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:48.122957 2609 hybrid_clock.cc:648] HybridClock initialized: now 1786214568122945 us; error 27 us; skew 500 ppm
I20260808 18:42:48.124801 2609 webserver.cc:460] Webserver started at http://127.4.61.254:43997/ using document root <none> and password file <none>
I20260808 18:42:48.125345 2609 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:48.125412 2609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:48.125615 2609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:48.127614 2609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "3e20682b959f4bf1a9fb77345f86c8d4"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "c52dee3797c3462ba25bbfb42148e222"
server_key_iv: "4f51db5e42d63c1f1195f3948cd46e30"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.128149 2609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "3e20682b959f4bf1a9fb77345f86c8d4"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "c52dee3797c3462ba25bbfb42148e222"
server_key_iv: "4f51db5e42d63c1f1195f3948cd46e30"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.131675 2609 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:48.133880 2629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.135059 2609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:48.135186 2609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "3e20682b959f4bf1a9fb77345f86c8d4"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "c52dee3797c3462ba25bbfb42148e222"
server_key_iv: "4f51db5e42d63c1f1195f3948cd46e30"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.135303 2609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:48.155053 2609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:48.155675 2609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:48.155839 2609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:48.162180 2609 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:42023
I20260808 18:42:48.162240 2695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:42023 every 8 connection(s)
I20260808 18:42:48.163115 2609 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:48.164846 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 2609
I20260808 18:42:48.164989 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:48.165364 4343 external_mini_cluster.cc:1428] Setting key ef07c41dbde96c018871959e0b62c808
I20260808 18:42:48.167577 2700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:48.174085 2700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: Bootstrap starting.
I20260808 18:42:48.174906 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.166916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47648 (local address 127.4.61.254:42023)
0808 18:42:48.167521 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.167535 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.167570 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:42:48.168241 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.168259 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.168639 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.168925 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:48.169315 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.170334 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.171587 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.172067 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.172181 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.173147 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:48.173152 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:48.173174 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:48.173550 (+ 376us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:48.173604 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:48.173624 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:48.173702 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.173876 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.174125 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":133,"threads_started":1}
I20260808 18:42:48.176543 2700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:48.177361 2700 log.cc:824] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:48.179342 2700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: No bootstrap required, opened a new log
I20260808 18:42:48.182717 2700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } }
I20260808 18:42:48.182941 2700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:48.182981 2700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e20682b959f4bf1a9fb77345f86c8d4, State: Initialized, Role: FOLLOWER
I20260808 18:42:48.183372 2700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } }
I20260808 18:42:48.183492 2700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:48.183542 2700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:48.183645 2700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:48.184625 2700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } }
I20260808 18:42:48.184934 2700 leader_election.cc:302] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e20682b959f4bf1a9fb77345f86c8d4; no voters:
I20260808 18:42:48.185207 2700 leader_election.cc:288] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:48.185328 2710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:48.185536 2710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [term 1 LEADER]: Becoming Leader. State: Replica: 3e20682b959f4bf1a9fb77345f86c8d4, State: Running, Role: LEADER
I20260808 18:42:48.185856 2710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } }
I20260808 18:42:48.186409 2700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:48.187498 2714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e20682b959f4bf1a9fb77345f86c8d4. Latest consensus state: current_term: 1 leader_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } } }
I20260808 18:42:48.187630 2714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:48.187940 2711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e20682b959f4bf1a9fb77345f86c8d4" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 42023 } } }
I20260808 18:42:48.188031 2711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:48.188067 2723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:48.191308 2723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:48.196841 2723 catalog_manager.cc:1347] Generated new cluster ID: de8f747fccb24378864f4f5a9effb730
I20260808 18:42:48.196909 2723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:48.212523 2723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:48.213861 2723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:48.221985 2723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: Generated new TSK 0
I20260808 18:42:48.222729 2723 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:48.225383 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.193:0
--local_ip_for_outbound_sockets=127.4.61.193
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--builtin_ntp_servers=127.4.61.212:42773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 18:42:48.363432 2737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:48.363696 2737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:48.363736 2737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:48.367697 2737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:48.367771 2737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:48.367830 2737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.193
I20260808 18:42:48.372625 2737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.61.193
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.193
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:48.373826 2737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:48.375311 2737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:48.385072 2750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.385099 2745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.385074 2746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:48.385443 2737 server_base.cc:1034] running on GCE node
I20260808 18:42:48.385830 2737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:48.386533 2737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:48.387657 2737 hybrid_clock.cc:648] HybridClock initialized: now 1786214568387641 us; error 31 us; skew 500 ppm
I20260808 18:42:48.393936 2737 webserver.cc:460] Webserver started at http://127.4.61.193:43021/ using document root <none> and password file <none>
I20260808 18:42:48.394596 2737 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:48.394675 2737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:48.394896 2737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:48.397012 2737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data/instance:
uuid: "311b1bd0feb5432297532cb3cab5ab71"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "38e4652d1be39aef7c2b52631675c107"
server_key_iv: "904d4454ef596375b1b8f12ebdb42ff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.397567 2737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance:
uuid: "311b1bd0feb5432297532cb3cab5ab71"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "38e4652d1be39aef7c2b52631675c107"
server_key_iv: "904d4454ef596375b1b8f12ebdb42ff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.401412 2737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:42:48.404219 2759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.405508 2737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:48.405650 2737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal
uuid: "311b1bd0feb5432297532cb3cab5ab71"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "38e4652d1be39aef7c2b52631675c107"
server_key_iv: "904d4454ef596375b1b8f12ebdb42ff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.405766 2737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:48.417495 2737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:48.418172 2737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:48.418367 2737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:48.418962 2737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:48.419912 2737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:48.419960 2737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.420013 2737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:48.420042 2737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.428757 2737 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.193:34451
I20260808 18:42:48.428803 2929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.193:34451 every 8 connection(s)
I20260808 18:42:48.429663 2737 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/data/info.pb
I20260808 18:42:48.433965 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 2737
I20260808 18:42:48.434082 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-0/wal/instance
I20260808 18:42:48.434471 4343 external_mini_cluster.cc:1428] Setting key 12ce4f0731c9b0c5560178493c5feb2d
I20260808 18:42:48.436563 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.194:0
--local_ip_for_outbound_sockets=127.4.61.194
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--builtin_ntp_servers=127.4.61.212:42773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:48.439751 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.431532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:51501 (local address 127.4.61.254:42023)
0808 18:42:48.431702 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.431707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.432783 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 18:42:48.434277 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.434281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.434373 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.434468 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:48.435463 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.436136 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.437709 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.437937 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.438030 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.439227 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:48.439280 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:48.439283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:48.439299 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:48.439324 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:48.439336 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:48.439404 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.439542 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.439626 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 18:42:48.440797 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.431934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42023 (local address 127.4.61.193:51501)
0808 18:42:48.432622 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.432663 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.433992 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.434644 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.434651 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.434737 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:48.435321 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.435339 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.436272 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.436276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.437579 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.437591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.438099 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.438103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.438304 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.438959 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:48.438960 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:48.439003 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:48.439067 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:48.439417 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:48.439425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:48.439430 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.439524 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.439823 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":119,"threads_started":1}
I20260808 18:42:48.441979 2930 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42023
I20260808 18:42:48.442245 2930 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:48.442932 2930 heartbeater.cc:511] Master 127.4.61.254:42023 requested a full tablet report, sending...
I20260808 18:42:48.444597 2651 ts_manager.cc:194] Registered new tserver with Master: 311b1bd0feb5432297532cb3cab5ab71 (127.4.61.193:34451)
I20260808 18:42:48.445760 2651 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.193:51501
W20260808 18:42:48.550750 2933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:48.551003 2933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:48.551040 2933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:48.554970 2933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:48.555016 2933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:48.555071 2933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.194
I20260808 18:42:48.559675 2933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.61.194
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.194
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:48.560675 2933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:48.562013 2933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:48.571233 2941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.571246 2940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:48.571344 2933 server_base.cc:1034] running on GCE node
W20260808 18:42:48.571249 2943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:48.571841 2933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:48.572440 2933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:48.573617 2933 hybrid_clock.cc:648] HybridClock initialized: now 1786214568573593 us; error 33 us; skew 500 ppm
I20260808 18:42:48.575407 2933 webserver.cc:460] Webserver started at http://127.4.61.194:39319/ using document root <none> and password file <none>
I20260808 18:42:48.575964 2933 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:48.576033 2933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:48.576239 2933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:48.578231 2933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data/instance:
uuid: "1551a3c61b444c858e6321ea0b375910"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "6df00d1dfc4b56328b17b87d0a66b0e0"
server_key_iv: "15a164892b3207edd22347d8decbb41f"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.578836 2933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance:
uuid: "1551a3c61b444c858e6321ea0b375910"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "6df00d1dfc4b56328b17b87d0a66b0e0"
server_key_iv: "15a164892b3207edd22347d8decbb41f"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.582470 2933 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:42:48.584839 2955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.586028 2933 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:48.586140 2933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal
uuid: "1551a3c61b444c858e6321ea0b375910"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "6df00d1dfc4b56328b17b87d0a66b0e0"
server_key_iv: "15a164892b3207edd22347d8decbb41f"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.586233 2933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:48.602810 2933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:48.603459 2933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:48.603655 2933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:48.604296 2933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:48.605252 2933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:48.605302 2933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.605356 2933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:48.605386 2933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.614334 2933 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.194:42757
I20260808 18:42:48.614406 3131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.194:42757 every 8 connection(s)
I20260808 18:42:48.615202 2933 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/data/info.pb
I20260808 18:42:48.623930 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.616974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.194:46087 (local address 127.4.61.254:42023)
0808 18:42:48.617143 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.617148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.618189 (+ 1041us) server_negotiation.cc:407] Connection header received
0808 18:42:48.619569 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.619573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.619622 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.619696 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:48.620533 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.621076 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.622219 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.622501 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.622585 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.623564 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:48.623567 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:48.623569 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:48.623580 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:48.623597 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:48.623604 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:48.623658 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.623762 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.623809 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 18:42:48.624478 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 2933
I20260808 18:42:48.624583 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal/instance
I20260808 18:42:48.624763 3136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.617377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42023 (local address 127.4.61.194:46087)
0808 18:42:48.618047 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.618086 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.619358 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.619852 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.619859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.619941 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:48.620402 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.620414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.621203 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.621207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.622101 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.622110 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.622617 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.622620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.622764 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.623333 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:48.623335 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:48.623374 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:48.623436 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:48.623666 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:48.623671 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:48.623674 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.623757 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.623993 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":114,"threads_started":1}
I20260808 18:42:48.624867 4343 external_mini_cluster.cc:1428] Setting key 47da2737d6617c18a13d9257204c9aca
I20260808 18:42:48.625865 3134 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42023
I20260808 18:42:48.626098 3134 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:48.626720 3134 heartbeater.cc:511] Master 127.4.61.254:42023 requested a full tablet report, sending...
I20260808 18:42:48.626832 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.61.195:0
--local_ip_for_outbound_sockets=127.4.61.195
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--builtin_ntp_servers=127.4.61.212:42773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 18:42:48.627813 2651 ts_manager.cc:194] Registered new tserver with Master: 1551a3c61b444c858e6321ea0b375910 (127.4.61.194:42757)
I20260808 18:42:48.628382 2651 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.194:46087
W20260808 18:42:48.741937 3137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:48.742197 3137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:48.742241 3137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:48.746279 3137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:48.746357 3137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:48.746444 3137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.61.195
I20260808 18:42:48.751185 3137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.61.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.61.195
--webserver_port=0
--tserver_master_addrs=127.4.61.254:42023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.61.195
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:48.752246 3137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:48.753619 3137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:48.763244 3148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.763238 3146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:48.763238 3145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:48.763664 3137 server_base.cc:1034] running on GCE node
I20260808 18:42:48.764055 3137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:48.764695 3137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:48.765861 3137 hybrid_clock.cc:648] HybridClock initialized: now 1786214568765839 us; error 31 us; skew 500 ppm
I20260808 18:42:48.767696 3137 webserver.cc:460] Webserver started at http://127.4.61.195:44433/ using document root <none> and password file <none>
I20260808 18:42:48.768268 3137 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:48.768347 3137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:48.768545 3137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:48.770665 3137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data/instance:
uuid: "9d2b64c36b00487fba6adbd693e0b49b"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "e0c35c3219e529c0327b5274ab8ecff5"
server_key_iv: "69492de6192f83f80540d9c4d83aba57"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.771209 3137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance:
uuid: "9d2b64c36b00487fba6adbd693e0b49b"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "e0c35c3219e529c0327b5274ab8ecff5"
server_key_iv: "69492de6192f83f80540d9c4d83aba57"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.775178 3137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 18:42:48.777618 3156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.778889 3137 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:42:48.779006 3137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal
uuid: "9d2b64c36b00487fba6adbd693e0b49b"
format_stamp: "Formatted at 2026-08-08 18:42:48 on dist-test-slave-fgb3"
server_key: "e0c35c3219e529c0327b5274ab8ecff5"
server_key_iv: "69492de6192f83f80540d9c4d83aba57"
server_key_version: "encryptionkey@0"
I20260808 18:42:48.779105 3137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:48.794674 3137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:48.795389 3137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:48.795580 3137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:48.796188 3137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 18:42:48.797197 3137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 18:42:48.797263 3137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.797324 3137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 18:42:48.797353 3137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:48.807126 3137 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.195:39055
I20260808 18:42:48.807164 3318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.195:39055 every 8 connection(s)
I20260808 18:42:48.808128 3137 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/data/info.pb
I20260808 18:42:48.814601 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 3137
I20260808 18:42:48.814719 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal/instance
I20260808 18:42:48.814996 4343 external_mini_cluster.cc:1428] Setting key cae9761833cf03ea1851785e81a4e5df
I20260808 18:42:48.817919 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.810104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.195:36751 (local address 127.4.61.254:42023)
0808 18:42:48.810271 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.810274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.811443 (+ 1169us) server_negotiation.cc:407] Connection header received
0808 18:42:48.812860 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.812864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.812925 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.812999 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:48.814017 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.814572 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.815886 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.816191 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.816301 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.817505 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:48.817509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:48.817511 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:48.817524 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:48.817546 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:48.817555 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:48.817628 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.817743 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.817798 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 18:42:48.818842 3328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.810634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:42023 (local address 127.4.61.195:36751)
0808 18:42:48.811294 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.811336 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.812640 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.813215 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.813224 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.813338 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:42:48.813864 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.813879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.814703 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.814706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.815773 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.815784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.816359 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.816363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.816559 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.817229 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 18:42:48.817231 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:42:48.817285 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 18:42:48.817349 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:42:48.817628 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:42:48.817632 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:42:48.817637 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.817724 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.817972 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260808 18:42:48.819885 3324 heartbeater.cc:347] Connected to a master server at 127.4.61.254:42023
I20260808 18:42:48.820125 3324 heartbeater.cc:464] Registering TS with master...
I20260808 18:42:48.820643 3324 heartbeater.cc:511] Master 127.4.61.254:42023 requested a full tablet report, sending...
I20260808 18:42:48.821637 2651 ts_manager.cc:194] Registered new tserver with Master: 9d2b64c36b00487fba6adbd693e0b49b (127.4.61.195:39055)
I20260808 18:42:48.822171 2651 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.61.195:36751
I20260808 18:42:48.828843 4343 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 18:42:48.834506 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.830797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.4.61.254:42023)
0808 18:42:48.830925 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.830930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.831112 (+ 182us) server_negotiation.cc:407] Connection header received
0808 18:42:48.831241 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.831244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.831291 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.831351 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:48.831616 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.832145 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.832982 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.833207 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.833293 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.834070 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:48.834073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:48.834076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:48.834089 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:48.834110 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:48.834117 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:48.834174 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.834272 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.834364 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:42:48.837167 2651 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 18:42:48.840324 2651 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 18:42:48.854562 3339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.848728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:34451 (local address 127.0.0.1:43376)
0808 18:42:48.849567 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.849579 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.849657 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.850403 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.850406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.850425 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:48.850531 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.850538 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851951 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.851954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.853054 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.853065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.854033 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.854037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.854127 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854150 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.854218 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.854418 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":39,"thread_start_us":150,"threads_started":1}
I20260808 18:42:48.854562 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.849807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.4.61.195:39055)
0808 18:42:48.850367 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.850379 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.850401 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:42:48.850527 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.850532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.850668 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.850793 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:48.850985 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851715 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.853043 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.853823 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.853941 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854145 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.854259 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.854377 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":161,"threads_started":1}
I20260808 18:42:48.854705 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.848616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42757 (local address 127.0.0.1:59224)
0808 18:42:48.848929 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.848976 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.849098 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.849877 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.849883 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.849906 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:48.850073 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.850080 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851694 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.851697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.853344 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.853351 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.854360 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.854364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.854451 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854472 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.854537 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.854597 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":31,"thread_start_us":59,"threads_started":1}
I20260808 18:42:48.855067 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.849390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:39055 (local address 127.0.0.1:34126)
0808 18:42:48.850298 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.850330 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.850421 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.850793 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.850795 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.850811 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:48.850900 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.850906 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851838 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.851841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.852930 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.852942 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.853960 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.853964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.854070 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854124 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.854230 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.854945 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":111,"thread_start_us":98,"threads_started":1}
I20260808 18:42:48.855166 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.848746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59224 (local address 127.4.61.194:42757)
0808 18:42:48.849365 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.849378 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.849403 (+ 25us) server_negotiation.cc:407] Connection header received
0808 18:42:48.849487 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.849493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.849703 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.850228 (+ 525us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:48.850402 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851572 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.853451 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.854003 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.854101 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854296 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.854916 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.855014 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":143,"threads_started":1}
I20260808 18:42:48.855254 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.849389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.4.61.193:34451)
0808 18:42:48.849920 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.849933 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.849956 (+ 23us) server_negotiation.cc:407] Connection header received
0808 18:42:48.850033 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.850038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.850228 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.850679 (+ 451us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:48.850817 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.851845 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.853176 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.853891 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.854417 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.854598 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.855039 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.855124 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":138,"threads_started":1}
I20260808 18:42:48.857847 3234 tablet_service.cc:1467] Processing CreateTablet for tablet 8161190c1c454ee8b2935e72716bf5ca (DEFAULT_TABLE table=test-table [id=48958a941387474092cf7317f3b98af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:48.858024 2827 tablet_service.cc:1467] Processing CreateTablet for tablet 8161190c1c454ee8b2935e72716bf5ca (DEFAULT_TABLE table=test-table [id=48958a941387474092cf7317f3b98af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:48.858024 3031 tablet_service.cc:1467] Processing CreateTablet for tablet 8161190c1c454ee8b2935e72716bf5ca (DEFAULT_TABLE table=test-table [id=48958a941387474092cf7317f3b98af7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 18:42:48.858878 3234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8161190c1c454ee8b2935e72716bf5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:48.859063 3031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8161190c1c454ee8b2935e72716bf5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:48.859063 2827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8161190c1c454ee8b2935e72716bf5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:48.864765 3345 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Bootstrap starting.
I20260808 18:42:48.866412 3348 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Bootstrap starting.
I20260808 18:42:48.867023 3346 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Bootstrap starting.
I20260808 18:42:48.867311 3345 tablet_bootstrap.cc:654] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:48.868207 3345 log.cc:824] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:48.868801 3346 tablet_bootstrap.cc:654] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:48.868975 3348 tablet_bootstrap.cc:654] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:48.869509 3346 log.cc:824] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:48.869767 3348 log.cc:824] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:48.870379 3345 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: No bootstrap required, opened a new log
I20260808 18:42:48.870645 3345 ts_tablet_manager.cc:1397] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 18:42:48.871551 3346 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: No bootstrap required, opened a new log
I20260808 18:42:48.871731 3346 ts_tablet_manager.cc:1397] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 18:42:48.871871 3348 tablet_bootstrap.cc:492] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: No bootstrap required, opened a new log
I20260808 18:42:48.872067 3348 ts_tablet_manager.cc:1397] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 18:42:48.874914 3346 raft_consensus.cc:348] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.875150 3346 raft_consensus.cc:374] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:48.875224 3346 raft_consensus.cc:729] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311b1bd0feb5432297532cb3cab5ab71, State: Initialized, Role: FOLLOWER
I20260808 18:42:48.875124 3345 raft_consensus.cc:348] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.875383 3345 raft_consensus.cc:374] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:48.875443 3345 raft_consensus.cc:729] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2b64c36b00487fba6adbd693e0b49b, State: Initialized, Role: FOLLOWER
I20260808 18:42:48.875684 3346 consensus_queue.cc:260] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.875870 3345 consensus_queue.cc:260] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.876374 2930 heartbeater.cc:503] Master 127.4.61.254:42023 was elected leader, sending a full tablet report...
I20260808 18:42:48.876721 3346 ts_tablet_manager.cc:1428] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 18:42:48.876979 3345 ts_tablet_manager.cc:1428] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 18:42:48.877140 3348 raft_consensus.cc:348] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.877394 3324 heartbeater.cc:503] Master 127.4.61.254:42023 was elected leader, sending a full tablet report...
I20260808 18:42:48.877436 3348 raft_consensus.cc:374] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:48.877503 3348 raft_consensus.cc:729] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1551a3c61b444c858e6321ea0b375910, State: Initialized, Role: FOLLOWER
I20260808 18:42:48.877884 3348 consensus_queue.cc:260] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.878535 3134 heartbeater.cc:503] Master 127.4.61.254:42023 was elected leader, sending a full tablet report...
I20260808 18:42:48.878837 3348 ts_tablet_manager.cc:1428] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 18:42:48.891641 3355 raft_consensus.cc:482] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 18:42:48.891889 3355 raft_consensus.cc:504] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.893163 3355 leader_election.cc:288] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1551a3c61b444c858e6321ea0b375910 (127.4.61.194:42757), 9d2b64c36b00487fba6adbd693e0b49b (127.4.61.195:39055)
I20260808 18:42:48.897037 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.893477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:44277 (local address 127.4.61.194:42757)
0808 18:42:48.893607 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.893611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.893626 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:42:48.893736 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.893739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.893789 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.893855 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:48.894254 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.894918 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896059 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.896490 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896586 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.896628 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.896834 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.896911 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:42:48.897025 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.893378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.194:42757 (local address 127.4.61.193:44277)
0808 18:42:48.893515 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.893534 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.893629 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.893986 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.893989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.894008 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:48.894115 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.894122 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.895033 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.895036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.895930 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.895941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.896605 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.896709 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.896737 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.896821 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.896889 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 18:42:48.897146 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.893787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.61.193:41867 (local address 127.4.61.195:39055)
0808 18:42:48.893935 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.893939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.894142 (+ 203us) server_negotiation.cc:407] Connection header received
0808 18:42:48.894239 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.894241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.894295 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.894391 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 18:42:48.894659 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.895209 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896219 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.896629 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896738 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.896781 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.896966 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.897035 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 18:42:48.897572 3360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.893659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.195:39055 (local address 127.4.61.193:41867)
0808 18:42:48.894057 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.894069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:42:48.894156 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:42:48.894405 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:42:48.894408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:42:48.894426 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 18:42:48.894555 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.894561 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.895312 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.895314 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.896100 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:42:48.896110 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.896752 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.896754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:42:48.896843 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.896868 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 18:42:48.896938 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 18:42:48.897014 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":128,"threads_started":1}
I20260808 18:42:48.897779 3059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8161190c1c454ee8b2935e72716bf5ca" candidate_uuid: "311b1bd0feb5432297532cb3cab5ab71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1551a3c61b444c858e6321ea0b375910" is_pre_election: true
I20260808 18:42:48.898168 3059 raft_consensus.cc:2454] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311b1bd0feb5432297532cb3cab5ab71 in term 0.
I20260808 18:42:48.898202 3256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8161190c1c454ee8b2935e72716bf5ca" candidate_uuid: "311b1bd0feb5432297532cb3cab5ab71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2b64c36b00487fba6adbd693e0b49b" is_pre_election: true
I20260808 18:42:48.898499 3256 raft_consensus.cc:2454] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311b1bd0feb5432297532cb3cab5ab71 in term 0.
I20260808 18:42:48.898823 2761 leader_election.cc:302] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1551a3c61b444c858e6321ea0b375910, 311b1bd0feb5432297532cb3cab5ab71; no voters:
I20260808 18:42:48.899085 3355 raft_consensus.cc:2781] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 18:42:48.899168 3355 raft_consensus.cc:482] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 18:42:48.899199 3355 raft_consensus.cc:3037] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:48.900255 3355 raft_consensus.cc:504] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.900604 3355 leader_election.cc:288] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [CANDIDATE]: Term 1 election: Requested vote from peers 1551a3c61b444c858e6321ea0b375910 (127.4.61.194:42757), 9d2b64c36b00487fba6adbd693e0b49b (127.4.61.195:39055)
I20260808 18:42:48.900933 3059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8161190c1c454ee8b2935e72716bf5ca" candidate_uuid: "311b1bd0feb5432297532cb3cab5ab71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1551a3c61b444c858e6321ea0b375910"
I20260808 18:42:48.901008 3256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8161190c1c454ee8b2935e72716bf5ca" candidate_uuid: "311b1bd0feb5432297532cb3cab5ab71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2b64c36b00487fba6adbd693e0b49b"
I20260808 18:42:48.901060 3059 raft_consensus.cc:3037] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:48.901125 3256 raft_consensus.cc:3037] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:48.902357 3256 raft_consensus.cc:2454] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 311b1bd0feb5432297532cb3cab5ab71 in term 1.
I20260808 18:42:48.902370 3059 raft_consensus.cc:2454] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 311b1bd0feb5432297532cb3cab5ab71 in term 1.
I20260808 18:42:48.902643 2761 leader_election.cc:302] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311b1bd0feb5432297532cb3cab5ab71, 9d2b64c36b00487fba6adbd693e0b49b; no voters:
I20260808 18:42:48.902905 3355 raft_consensus.cc:2781] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:48.903137 3355 raft_consensus.cc:686] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 1 LEADER]: Becoming Leader. State: Replica: 311b1bd0feb5432297532cb3cab5ab71, State: Running, Role: LEADER
I20260808 18:42:48.903487 3355 consensus_queue.cc:237] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } }
I20260808 18:42:48.906733 2650 catalog_manager.cc:5495] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 311b1bd0feb5432297532cb3cab5ab71 (127.4.61.193). New cstate: current_term: 1 leader_uuid: "311b1bd0feb5432297532cb3cab5ab71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "311b1bd0feb5432297532cb3cab5ab71" member_type: VOTER last_known_addr { host: "127.4.61.193" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 } health_report { overall_health: UNKNOWN } } }
I20260808 18:42:48.924033 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.920499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43384 (local address 127.4.61.193:34451)
0808 18:42:48.920633 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:48.920637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:48.920652 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:42:48.920786 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:48.920789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:48.920847 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:48.920937 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:42:48.921165 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.921690 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.922619 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:48.922842 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:48.922933 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:48.923238 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:42:48.923666 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:42:48.923784 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:48.923840 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 18:42:48.923894 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 18:42:48.930069 3256 raft_consensus.cc:1261] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 1 FOLLOWER]: Refusing update from remote peer 311b1bd0feb5432297532cb3cab5ab71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:42:48.930101 3059 raft_consensus.cc:1261] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 1 FOLLOWER]: Refusing update from remote peer 311b1bd0feb5432297532cb3cab5ab71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 18:42:48.930763 2931 tablet.cc:2369] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:42:48.930825 3355 consensus_queue.cc:1035] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1551a3c61b444c858e6321ea0b375910" member_type: VOTER last_known_addr { host: "127.4.61.194" port: 42757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:48.930997 3362 consensus_queue.cc:1035] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2b64c36b00487fba6adbd693e0b49b" member_type: VOTER last_known_addr { host: "127.4.61.195" port: 39055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:42:48.939496 3371 mvcc.cc:205] Tried to move back new op lower bound from 7316334874329743360 to 7316334874231635968. Current Snapshot: MvccSnapshot[applied={T|T < 7316334874329743360}]
I20260808 18:42:48.940219 3372 mvcc.cc:205] Tried to move back new op lower bound from 7316334874329743360 to 7316334874231635968. Current Snapshot: MvccSnapshot[applied={T|T < 7316334874329743360}]
I20260808 18:42:48.948963 2647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:48.949118 2647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 18:42:48.951395 2647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e20682b959f4bf1a9fb77345f86c8d4: Sending DeleteTablet for 3 replicas of tablet 8161190c1c454ee8b2935e72716bf5ca
I20260808 18:42:48.952257 2827 tablet_service.cc:1514] Processing DeleteTablet for tablet 8161190c1c454ee8b2935e72716bf5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:48 UTC) from {username='slave'} at 127.0.0.1:43376
I20260808 18:42:48.952314 3031 tablet_service.cc:1514] Processing DeleteTablet for tablet 8161190c1c454ee8b2935e72716bf5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:48 UTC) from {username='slave'} at 127.0.0.1:59224
I20260808 18:42:48.952291 3234 tablet_service.cc:1514] Processing DeleteTablet for tablet 8161190c1c454ee8b2935e72716bf5ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 18:42:48 UTC) from {username='slave'} at 127.0.0.1:34126
I20260808 18:42:48.952754 3383 tablet_replica.cc:330] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71: stopping tablet replica
I20260808 18:42:48.952922 3385 tablet_replica.cc:330] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: stopping tablet replica
I20260808 18:42:48.953063 3383 raft_consensus.cc:2229] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 1 LEADER]: Raft consensus shutting down.
I20260808 18:42:48.953344 3384 tablet_replica.cc:330] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: stopping tablet replica
I20260808 18:42:48.953433 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 2737
I20260808 18:42:48.953452 3383 raft_consensus.cc:2258] T 8161190c1c454ee8b2935e72716bf5ca P 311b1bd0feb5432297532cb3cab5ab71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:48.953680 3384 raft_consensus.cc:2229] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:48.953972 3384 raft_consensus.cc:2258] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:48.960819 3384 ts_tablet_manager.cc:1905] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:48.964314 3384 ts_tablet_manager.cc:1918] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:48.964427 3384 log.cc:1196] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-1/wal/wals/8161190c1c454ee8b2935e72716bf5ca
I20260808 18:42:48.964805 3384 ts_tablet_manager.cc:1939] T 8161190c1c454ee8b2935e72716bf5ca P 1551a3c61b444c858e6321ea0b375910: Deleting consensus metadata
I20260808 18:42:48.966434 2632 catalog_manager.cc:4841] TS 1551a3c61b444c858e6321ea0b375910 (127.4.61.194:42757): tablet 8161190c1c454ee8b2935e72716bf5ca (table test-table [id=48958a941387474092cf7317f3b98af7]) successfully deleted
I20260808 18:42:48.968885 3385 raft_consensus.cc:2229] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 18:42:48.969240 3385 raft_consensus.cc:2258] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 18:42:48.970866 3385 ts_tablet_manager.cc:1905] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 18:42:48.973124 3385 ts_tablet_manager.cc:1918] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 18:42:48.973223 3385 log.cc:1196] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Deleting WAL directory at /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786214311986709-4343-0/minicluster-data/ts-2/wal/wals/8161190c1c454ee8b2935e72716bf5ca
I20260808 18:42:48.973515 3385 ts_tablet_manager.cc:1939] T 8161190c1c454ee8b2935e72716bf5ca P 9d2b64c36b00487fba6adbd693e0b49b: Deleting consensus metadata
I20260808 18:42:48.974735 2632 catalog_manager.cc:4841] TS 9d2b64c36b00487fba6adbd693e0b49b (127.4.61.195:39055): tablet 8161190c1c454ee8b2935e72716bf5ca (table test-table [id=48958a941387474092cf7317f3b98af7]) successfully deleted
W20260808 18:42:48.975587 2630 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.61.193:34451 (error 108)
I20260808 18:42:48.975673 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 2933
I20260808 18:42:48.979873 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:48.979579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.193:34451 (local address 127.0.0.1:43396)
0808 18:42:48.979713 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 18:42:48.979788 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.193:34451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 18:42:48.980036 2630 catalog_manager.cc:4584] TS 311b1bd0feb5432297532cb3cab5ab71 (127.4.61.193:34451): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8161190c1c454ee8b2935e72716bf5ca: Network error: Client connection negotiation failed: client connection to 127.4.61.193:34451: connect: Connection refused (error 111)
I20260808 18:42:48.988358 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 3137
I20260808 18:42:48.999105 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 2609
2026-08-08T18:42:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1048 ms)
[----------] 6 tests from EncryptionPolicyTest (10857 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:49 dist-test-slave-fgb3 krb5kdc[3390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:49 dist-test-slave-fgb3 krb5kdc[3390](info): set up 2 sockets
Aug 08 18:42:49 dist-test-slave-fgb3 krb5kdc[3390](info): commencing operation
krb5kdc: starting...
W20260808 18:42:50.145171 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:50.273994 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38959
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:50.387459 3408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:50.387707 3408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:50.387748 3408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:50.391650 3408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:50.391714 3408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:50.391732 3408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:50.391748 3408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:50.391762 3408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:50.396919 3408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38959
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:50.397921 3408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:50.398990 3408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:50.407739 3420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:50.407760 3414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:50.407737 3416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:50.407780 3408 server_base.cc:1034] running on GCE node
I20260808 18:42:50.408635 3408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:50.409798 3408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:50.410965 3408 hybrid_clock.cc:648] HybridClock initialized: now 1786214570410949 us; error 29 us; skew 500 ppm
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214570, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:50.413803 3408 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:50.414772 3408 webserver.cc:460] Webserver started at http://127.0.0.1:40327/ using document root <none> and password file <none>
I20260808 18:42:50.415318 3408 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:50.415387 3408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:50.415594 3408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:50.417768 3408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c"
format_stamp: "Formatted at 2026-08-08 18:42:50 on dist-test-slave-fgb3"
server_key: "d8f1f718aa96c7588b010669ce1d324b"
server_key_iv: "8a2f04ac64e4f8fd8bc3f1633c2ff1e2"
server_key_version: "encryptionkey@0"
I20260808 18:42:50.418377 3408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c"
format_stamp: "Formatted at 2026-08-08 18:42:50 on dist-test-slave-fgb3"
server_key: "d8f1f718aa96c7588b010669ce1d324b"
server_key_iv: "8a2f04ac64e4f8fd8bc3f1633c2ff1e2"
server_key_version: "encryptionkey@0"
I20260808 18:42:50.422163 3408 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 18:42:50.424744 3431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:50.426038 3408 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 18:42:50.426179 3408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c"
format_stamp: "Formatted at 2026-08-08 18:42:50 on dist-test-slave-fgb3"
server_key: "d8f1f718aa96c7588b010669ce1d324b"
server_key_iv: "8a2f04ac64e4f8fd8bc3f1633c2ff1e2"
server_key_version: "encryptionkey@0"
I20260808 18:42:50.426354 3408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:50.456080 3408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:50.459414 3408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:50.459630 3408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:50.467166 3408 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38959
I20260808 18:42:50.467206 3506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38959 every 8 connection(s)
I20260808 18:42:50.468251 3408 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:50.471221 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 3408
I20260808 18:42:50.471302 3508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:50.471364 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:50.471647 4343 external_mini_cluster.cc:1428] Setting key f2dbdd3280bced72a12b2c43e4371861
I20260808 18:42:50.478615 3508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: Bootstrap starting.
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 18:42:50.481390 3508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:50.482298 3508 log.cc:824] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:50.484501 3508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: No bootstrap required, opened a new log
I20260808 18:42:50.486337 3511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:50.472954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60347 (local address 127.0.0.1:38959)
0808 18:42:50.473365 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:50.473380 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:50.473421 (+ 41us) server_negotiation.cc:407] Connection header received
0808 18:42:50.474108 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:50.474127 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:50.474655 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:50.475009 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:50.475845 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:50.476880 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:50.477768 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:50.478291 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:50.478487 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:50.481271 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:50.481277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:50.481292 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:50.481324 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:50.483249 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:50.483786 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:50.483792 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:50.483797 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:50.483913 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:50.484310 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:50.484313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:50.484314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:50.484773 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:50.484980 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:50.485337 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 18:42:50.485562 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":125,"threads_started":1}
I20260808 18:42:50.488516 3508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 18:42:50.488776 3508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:50.488845 3508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f06f05d9f64dae8b135d8fbb1d5f0c, State: Initialized, Role: FOLLOWER
I20260808 18:42:50.489341 3508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 18:42:50.489513 3508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:50.489545 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:50.489583 3508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:50.489686 3508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:50.490669 3508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 18:42:50.491034 3508 leader_election.cc:302] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67f06f05d9f64dae8b135d8fbb1d5f0c; no voters:
I20260808 18:42:50.491364 3508 leader_election.cc:288] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:50.491434 3519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:50.491822 3519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [term 1 LEADER]: Becoming Leader. State: Replica: 67f06f05d9f64dae8b135d8fbb1d5f0c, State: Running, Role: LEADER
I20260808 18:42:50.492216 3519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 18:42:50.492862 3508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:50.494709 3525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } } }
I20260808 18:42:50.494716 3524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67f06f05d9f64dae8b135d8fbb1d5f0c. Latest consensus state: current_term: 1 leader_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f06f05d9f64dae8b135d8fbb1d5f0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } } }
I20260808 18:42:50.494961 3524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:50.494959 3525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c [sys.catalog]: This master's current role is: LEADER
W20260808 18:42:50.497785 3541 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:42:50.497848 3541 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:42:50.497951 3542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:50.498858 3542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:50.500707 3511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:50.491565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44931 (local address 127.0.0.1:38959)
0808 18:42:50.491665 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:50.491669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:50.491889 (+ 220us) server_negotiation.cc:407] Connection header received
0808 18:42:50.492074 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:50.492078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:50.492125 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:50.492201 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:50.493164 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:50.493939 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:50.495305 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:50.495634 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:50.495735 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:50.497440 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:50.497444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:50.497447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:50.497473 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:50.498978 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:50.499520 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:50.499523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:50.499524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:50.499609 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:50.499934 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:50.499937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:50.499939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:50.500116 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:50.500223 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:50.500504 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 18:42:50.500584 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 18:42:50.504840 3542 catalog_manager.cc:1347] Generated new cluster ID: 85a65cbbca11415798dcb07d7ac965be
I20260808 18:42:50.504918 3542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:50.514928 3542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:50.515918 3542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:50.528620 3542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67f06f05d9f64dae8b135d8fbb1d5f0c: Generated new TSK 0
I20260808 18:42:50.529387 3542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:50.539021 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 3408
W20260808 18:42:50.554250 3388 connection.cc:535] client connection to 127.0.0.1:38959 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38959): Connection reset by peer (error 104)
2026-08-08T18:42:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3552](info): set up 2 sockets
Aug 08 18:42:50 dist-test-slave-fgb3 krb5kdc[3552](info): commencing operation
krb5kdc: starting...
W20260808 18:42:51.688383 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:51 dist-test-slave-fgb3 krb5kdc[3552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:51.815099 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:51.927798 3571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:51.928068 3571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:51.928129 3571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:51.932092 3571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:51.932150 3571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:51.932178 3571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:51.932199 3571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:51.932229 3571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:51.937486 3571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40647
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:51.938500 3571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:51.939479 3571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:51.947768 3580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:51.947911 3571 server_base.cc:1034] running on GCE node
W20260808 18:42:51.947774 3582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:51.947774 3579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:51.948585 3571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:51.949657 3571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:51.950829 3571 hybrid_clock.cc:648] HybridClock initialized: now 1786214571950803 us; error 37 us; skew 500 ppm
Aug 08 18:42:51 dist-test-slave-fgb3 krb5kdc[3552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214571, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:51.953630 3571 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:51.954568 3571 webserver.cc:460] Webserver started at http://127.0.0.1:45905/ using document root <none> and password file <none>
I20260808 18:42:51.955106 3571 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:51.955179 3571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:51.955400 3571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:51.957465 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "f8ec8c68bb57401581358fad20e0fb48"
format_stamp: "Formatted at 2026-08-08 18:42:51 on dist-test-slave-fgb3"
server_key: "cdf4f98232f587336c567666ca7f75a1"
server_key_iv: "a492fce20e123c8c4b98828d9fb01433"
server_key_version: "encryptionkey@0"
I20260808 18:42:51.958061 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "f8ec8c68bb57401581358fad20e0fb48"
format_stamp: "Formatted at 2026-08-08 18:42:51 on dist-test-slave-fgb3"
server_key: "cdf4f98232f587336c567666ca7f75a1"
server_key_iv: "a492fce20e123c8c4b98828d9fb01433"
server_key_version: "encryptionkey@0"
I20260808 18:42:51.961850 3571 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:42:51.964174 3598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:51.965416 3571 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:51.965544 3571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "f8ec8c68bb57401581358fad20e0fb48"
format_stamp: "Formatted at 2026-08-08 18:42:51 on dist-test-slave-fgb3"
server_key: "cdf4f98232f587336c567666ca7f75a1"
server_key_iv: "a492fce20e123c8c4b98828d9fb01433"
server_key_version: "encryptionkey@0"
I20260808 18:42:51.965642 3571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:51.975258 3571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:51.978235 3571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:51.978432 3571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:51.985040 3571 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40647
I20260808 18:42:51.985049 3681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40647 every 8 connection(s)
I20260808 18:42:51.985956 3571 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:51.988683 3682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:51.992050 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 3571
I20260808 18:42:51.992182 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:51.992447 4343 external_mini_cluster.cc:1428] Setting key e7ded3a818dfad19467c5c4ce0555f8b
I20260808 18:42:51.994426 3682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48: Bootstrap starting.
I20260808 18:42:51.996693 3682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:51.997573 3682 log.cc:824] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:51.999737 3682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48: No bootstrap required, opened a new log
I20260808 18:42:52.001219 3688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:51.993797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42161 (local address 127.0.0.1:40647)
0808 18:42:51.994178 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:51.994193 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:51.994227 (+ 34us) server_negotiation.cc:407] Connection header received
0808 18:42:51.994893 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:51.994912 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:51.995254 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:51.995518 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:51.995845 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:51.996799 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:51.998013 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:51.998644 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:51.998769 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:51.999616 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:51.999621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:51.999633 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:52.000030 (+ 397us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:52.000083 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:52.000106 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:52.000204 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:52.000390 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 18:42:52.000519 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":104,"threads_started":1}
I20260808 18:42:52.003566 3682 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } }
I20260808 18:42:52.003829 3682 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:52.003898 3682 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8ec8c68bb57401581358fad20e0fb48, State: Initialized, Role: FOLLOWER
I20260808 18:42:52.004168 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:52.004333 3682 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } }
I20260808 18:42:52.004496 3682 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:52.004554 3682 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:52.004647 3682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:52.005739 3682 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } }
I20260808 18:42:52.006106 3682 leader_election.cc:302] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8ec8c68bb57401581358fad20e0fb48; no voters:
I20260808 18:42:52.006464 3682 leader_election.cc:288] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:52.006634 3701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:52.006834 3701 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [term 1 LEADER]: Becoming Leader. State: Replica: f8ec8c68bb57401581358fad20e0fb48, State: Running, Role: LEADER
I20260808 18:42:52.007170 3701 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } }
I20260808 18:42:52.007786 3682 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:52.008423 3701 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8ec8c68bb57401581358fad20e0fb48. Latest consensus state: current_term: 1 leader_uuid: "f8ec8c68bb57401581358fad20e0fb48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } } }
I20260808 18:42:52.008598 3701 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:52.008821 3704 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8ec8c68bb57401581358fad20e0fb48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ec8c68bb57401581358fad20e0fb48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40647 } } }
I20260808 18:42:52.008939 3704 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:52.008996 3716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:52.011433 3688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:52.006398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35647 (local address 127.0.0.1:40647)
0808 18:42:52.006513 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:52.006517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:52.006741 (+ 224us) server_negotiation.cc:407] Connection header received
0808 18:42:52.006934 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:52.006937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:52.006982 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:52.007028 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:52.007416 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:52.008195 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:52.009309 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:52.009624 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:52.009696 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:52.010848 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:52.010852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:52.010854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:52.010867 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:52.010894 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:52.010905 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:52.010961 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:52.011276 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 18:42:52.011311 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:42:52.012398 3716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:52.017922 3716 catalog_manager.cc:1347] Generated new cluster ID: d68120cf7f664e688f3613e1715fdf44
I20260808 18:42:52.018002 3716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:52.030227 3716 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:52.031128 3716 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:52.039848 3716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8ec8c68bb57401581358fad20e0fb48: Generated new TSK 0
I20260808 18:42:52.040498 3716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:52.053467 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 3571
W20260808 18:42:52.063674 3549 connection.cc:535] client connection to 127.0.0.1:40647 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40647): Connection reset by peer (error 104)
2026-08-08T18:42:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:52 dist-test-slave-fgb3 krb5kdc[3733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:52 dist-test-slave-fgb3 krb5kdc[3733](info): set up 2 sockets
Aug 08 18:42:52 dist-test-slave-fgb3 krb5kdc[3733](info): commencing operation
krb5kdc: starting...
W20260808 18:42:53.200562 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:53 dist-test-slave-fgb3 krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:53.323176 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45879
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:53.432542 3754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:53.432827 3754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:53.432886 3754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:53.436858 3754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:53.436923 3754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:53.436950 3754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:53.436972 3754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:53.436997 3754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:53.442224 3754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45879
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:53.443288 3754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:53.444290 3754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:53.452378 3764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:53.452342 3768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:53.452354 3766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:53.452425 3754 server_base.cc:1034] running on GCE node
I20260808 18:42:53.453127 3754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:53.454195 3754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:53.455355 3754 hybrid_clock.cc:648] HybridClock initialized: now 1786214573455336 us; error 31 us; skew 500 ppm
Aug 08 18:42:53 dist-test-slave-fgb3 krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214573, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:53.461493 3754 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:53.462473 3754 webserver.cc:460] Webserver started at http://127.0.0.1:33191/ using document root <none> and password file <none>
I20260808 18:42:53.463030 3754 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:53.463099 3754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:53.463311 3754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:53.465371 3754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "1cc767fcf14a42bea70e3f8d17d07c7f"
format_stamp: "Formatted at 2026-08-08 18:42:53 on dist-test-slave-fgb3"
server_key: "e26aeb4eb6ed85707856e458dc9344c1"
server_key_iv: "d2b72bae5c28ee3f8bb8186a32057717"
server_key_version: "encryptionkey@0"
I20260808 18:42:53.465941 3754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "1cc767fcf14a42bea70e3f8d17d07c7f"
format_stamp: "Formatted at 2026-08-08 18:42:53 on dist-test-slave-fgb3"
server_key: "e26aeb4eb6ed85707856e458dc9344c1"
server_key_iv: "d2b72bae5c28ee3f8bb8186a32057717"
server_key_version: "encryptionkey@0"
I20260808 18:42:53.469682 3754 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 18:42:53.472265 3776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:53.473436 3754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:53.473553 3754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "1cc767fcf14a42bea70e3f8d17d07c7f"
format_stamp: "Formatted at 2026-08-08 18:42:53 on dist-test-slave-fgb3"
server_key: "e26aeb4eb6ed85707856e458dc9344c1"
server_key_iv: "d2b72bae5c28ee3f8bb8186a32057717"
server_key_version: "encryptionkey@0"
I20260808 18:42:53.473655 3754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:53.478183 3754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:53.480964 3754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:53.481135 3754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:53.487931 3754 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45879
I20260808 18:42:53.487983 3856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45879 every 8 connection(s)
I20260808 18:42:53.488857 3754 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:53.489090 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 3754
I20260808 18:42:53.489216 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:53.489611 4343 external_mini_cluster.cc:1428] Setting key c840c1649cc7af5a527cce72f6b96eeb
I20260808 18:42:53.491999 3857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:53.494714 3862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:53.490959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56107 (local address 127.0.0.1:45879)
0808 18:42:53.491372 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:53.491390 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:53.491439 (+ 49us) server_negotiation.cc:407] Connection header received
0808 18:42:53.492094 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:53.492118 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:53.492416 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:53.492698 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:53.493497 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:53.493502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:53.493514 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:53.493524 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:53.493578 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:53.493597 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:53.493707 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:53.493794 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 18:42:53.493929 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":111,"threads_started":1}
I20260808 18:42:53.497386 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:53.498297 3857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f: Bootstrap starting.
I20260808 18:42:53.500981 3857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:53.501345 3862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:53.499768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46813 (local address 127.0.0.1:45879)
0808 18:42:53.499891 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:53.499896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:53.500077 (+ 181us) server_negotiation.cc:407] Connection header received
0808 18:42:53.500169 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:53.500172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:53.500208 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:53.500296 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:53.500904 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:53.500907 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:53.500910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:53.500923 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:53.500953 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:53.500966 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:53.501052 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:53.501174 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 18:42:53.501217 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:42:53.501871 3857 log.cc:824] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:53.503911 3857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f: No bootstrap required, opened a new log
I20260808 18:42:53.507587 3857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } }
I20260808 18:42:53.507840 3857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:53.507877 3857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc767fcf14a42bea70e3f8d17d07c7f, State: Initialized, Role: FOLLOWER
I20260808 18:42:53.508260 3857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } }
I20260808 18:42:53.508375 3857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:53.508420 3857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:53.508496 3857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:53.509541 3857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } }
I20260808 18:42:53.509891 3857 leader_election.cc:302] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cc767fcf14a42bea70e3f8d17d07c7f; no voters:
I20260808 18:42:53.510227 3857 leader_election.cc:288] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:53.510370 3876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:53.510593 3876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1cc767fcf14a42bea70e3f8d17d07c7f, State: Running, Role: LEADER
I20260808 18:42:53.510960 3876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } }
I20260808 18:42:53.511457 3857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:53.512607 3878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cc767fcf14a42bea70e3f8d17d07c7f. Latest consensus state: current_term: 1 leader_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } } }
I20260808 18:42:53.512734 3878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:53.513155 3890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:53.516655 3890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:53.513319 3877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc767fcf14a42bea70e3f8d17d07c7f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45879 } } }
I20260808 18:42:53.518026 3877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:53.522351 3890 catalog_manager.cc:1347] Generated new cluster ID: 067546b0dad44f43924cd695ef684ece
I20260808 18:42:53.522408 3890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:53.533457 3890 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:53.533767 3890 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:53.539893 3890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1cc767fcf14a42bea70e3f8d17d07c7f: Generated new TSK 0
I20260808 18:42:53.540551 3890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:53.547432 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 3754
2026-08-08T18:42:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1511 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:53 dist-test-slave-fgb3 krb5kdc[3908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:53 dist-test-slave-fgb3 krb5kdc[3908](info): set up 2 sockets
Aug 08 18:42:53 dist-test-slave-fgb3 krb5kdc[3908](info): commencing operation
krb5kdc: starting...
W20260808 18:42:54.695102 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:54 dist-test-slave-fgb3 krb5kdc[3908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:54.823374 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33343
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:54.933408 3925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:54.933650 3925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:54.933688 3925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:54.937567 3925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:54.937623 3925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:54.937640 3925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:54.937655 3925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:54.937668 3925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:54.942718 3925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:54.943620 3925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:54.944526 3925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:54.952661 3931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:54.952636 3934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:54.952754 3925 server_base.cc:1034] running on GCE node
W20260808 18:42:54.952636 3937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:54.953447 3925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:54.954581 3925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:54.955772 3925 hybrid_clock.cc:648] HybridClock initialized: now 1786214574955758 us; error 27 us; skew 500 ppm
Aug 08 18:42:54 dist-test-slave-fgb3 krb5kdc[3908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214574, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:54.958483 3925 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:54.959380 3925 webserver.cc:460] Webserver started at http://127.0.0.1:37079/ using document root <none> and password file <none>
I20260808 18:42:54.960047 3925 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:54.960124 3925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:54.960325 3925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:54.962267 3925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "ba04a085514d4be9be183e92e4eda771"
format_stamp: "Formatted at 2026-08-08 18:42:54 on dist-test-slave-fgb3"
server_key: "a23468481d0b0fb0f4055b6a0786eda4"
server_key_iv: "62e4672098bf8e9d94a550adc7164fcb"
server_key_version: "encryptionkey@0"
I20260808 18:42:54.962870 3925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "ba04a085514d4be9be183e92e4eda771"
format_stamp: "Formatted at 2026-08-08 18:42:54 on dist-test-slave-fgb3"
server_key: "a23468481d0b0fb0f4055b6a0786eda4"
server_key_iv: "62e4672098bf8e9d94a550adc7164fcb"
server_key_version: "encryptionkey@0"
I20260808 18:42:54.966246 3925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 18:42:54.968560 3945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:54.969712 3925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:42:54.969834 3925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "ba04a085514d4be9be183e92e4eda771"
format_stamp: "Formatted at 2026-08-08 18:42:54 on dist-test-slave-fgb3"
server_key: "a23468481d0b0fb0f4055b6a0786eda4"
server_key_iv: "62e4672098bf8e9d94a550adc7164fcb"
server_key_version: "encryptionkey@0"
I20260808 18:42:54.969926 3925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:54.995349 3925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:54.998214 3925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:54.998440 3925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:55.005167 3925 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33343
I20260808 18:42:55.005198 4028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33343 every 8 connection(s)
I20260808 18:42:55.006138 3925 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:55.008985 4029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:55.009865 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 3925
I20260808 18:42:55.010013 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:55.010383 4343 external_mini_cluster.cc:1428] Setting key 881e42623721259ade2f71402dacc78e
I20260808 18:42:55.015327 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771: Bootstrap starting.
I20260808 18:42:55.017623 4029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:55.018420 4029 log.cc:824] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:42:55 dist-test-slave-fgb3 krb5kdc[3908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 18:42:55.020414 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771: No bootstrap required, opened a new log
I20260808 18:42:55.024065 4029 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } }
I20260808 18:42:55.024291 4029 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:55.024326 4029 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba04a085514d4be9be183e92e4eda771, State: Initialized, Role: FOLLOWER
I20260808 18:42:55.024453 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:55.011902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43101 (local address 127.0.0.1:33343)
0808 18:42:55.012364 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:55.012381 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:55.012417 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:42:55.013060 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:55.013077 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:55.013419 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:55.013727 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:55.014601 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:55.015632 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:55.016515 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:55.017007 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:55.017153 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:55.019827 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:55.019833 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:55.019848 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:55.019877 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:55.021638 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:55.022067 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:55.022073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:55.022078 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:55.022196 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:55.022490 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:55.022493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:55.022495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:55.022898 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:55.023102 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:55.023387 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 18:42:55.023668 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":133,"threads_started":1}
I20260808 18:42:55.024780 4029 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } }
I20260808 18:42:55.024920 4029 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:55.024982 4029 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:55.025069 4029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:55.026160 4029 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } }
I20260808 18:42:55.026515 4029 leader_election.cc:302] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba04a085514d4be9be183e92e4eda771; no voters:
I20260808 18:42:55.026844 4029 leader_election.cc:288] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:55.026933 4038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:55.027160 4038 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [term 1 LEADER]: Becoming Leader. State: Replica: ba04a085514d4be9be183e92e4eda771, State: Running, Role: LEADER
I20260808 18:42:55.027519 4038 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } }
I20260808 18:42:55.027634 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:55.028203 4029 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:55.029035 4042 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba04a085514d4be9be183e92e4eda771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } } }
I20260808 18:42:55.029157 4042 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:55.029561 4039 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba04a085514d4be9be183e92e4eda771. Latest consensus state: current_term: 1 leader_uuid: "ba04a085514d4be9be183e92e4eda771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba04a085514d4be9be183e92e4eda771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33343 } } }
I20260808 18:42:55.029706 4039 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:55.030740 4057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:55.033614 4057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:55.038784 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:55.030096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48647 (local address 127.0.0.1:33343)
0808 18:42:55.030203 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:55.030208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:55.030729 (+ 521us) server_negotiation.cc:407] Connection header received
0808 18:42:55.030990 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:55.030993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:55.031043 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:55.031113 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:55.031805 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:55.032569 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:55.033669 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:55.033992 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:55.034101 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:55.035749 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:55.035753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:55.035756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:55.035781 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:55.037015 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:55.037441 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:55.037444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:55.037446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:55.037518 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:55.037813 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:55.037817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:55.037819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:55.038068 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:55.038202 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:55.038507 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 18:42:55.038630 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:42:55.039708 4057 catalog_manager.cc:1347] Generated new cluster ID: aa78fb43441549b7bd2e132a168df6ea
I20260808 18:42:55.039762 4057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:55.061661 4057 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:55.062676 4057 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:55.068987 4057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba04a085514d4be9be183e92e4eda771: Generated new TSK 0
I20260808 18:42:55.069700 4057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:55.073071 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 3925
2026-08-08T18:42:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:55 dist-test-slave-fgb3 krb5kdc[4076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:55 dist-test-slave-fgb3 krb5kdc[4076](info): set up 2 sockets
Aug 08 18:42:55 dist-test-slave-fgb3 krb5kdc[4076](info): commencing operation
krb5kdc: starting...
W20260808 18:42:56.215590 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:56 dist-test-slave-fgb3 krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:56.337188 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36811
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:56.447217 4095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:56.447465 4095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:56.447505 4095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:56.451403 4095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:56.451454 4095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:56.451472 4095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:56.451488 4095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:56.451501 4095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:56.456581 4095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:56.457549 4095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:56.458554 4095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:56.466560 4110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:56.466580 4102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:56.466578 4101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:56.466616 4095 server_base.cc:1034] running on GCE node
I20260808 18:42:56.467376 4095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:56.468461 4095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:56.469627 4095 hybrid_clock.cc:648] HybridClock initialized: now 1786214576469606 us; error 32 us; skew 500 ppm
Aug 08 18:42:56 dist-test-slave-fgb3 krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214576, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:56.472332 4095 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:56.473239 4095 webserver.cc:460] Webserver started at http://127.0.0.1:32815/ using document root <none> and password file <none>
I20260808 18:42:56.473788 4095 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:56.473857 4095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:56.474063 4095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:56.476210 4095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "7942a6253d9c4affb325db4659157f9e"
format_stamp: "Formatted at 2026-08-08 18:42:56 on dist-test-slave-fgb3"
server_key: "589389dfafb88cdfb146f9bf98b6493d"
server_key_iv: "ce7e5266105ee63798d96dd5839b7f9e"
server_key_version: "encryptionkey@0"
I20260808 18:42:56.476774 4095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "7942a6253d9c4affb325db4659157f9e"
format_stamp: "Formatted at 2026-08-08 18:42:56 on dist-test-slave-fgb3"
server_key: "589389dfafb88cdfb146f9bf98b6493d"
server_key_iv: "ce7e5266105ee63798d96dd5839b7f9e"
server_key_version: "encryptionkey@0"
I20260808 18:42:56.480569 4095 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 18:42:56.482928 4122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:56.484102 4095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:42:56.484221 4095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "7942a6253d9c4affb325db4659157f9e"
format_stamp: "Formatted at 2026-08-08 18:42:56 on dist-test-slave-fgb3"
server_key: "589389dfafb88cdfb146f9bf98b6493d"
server_key_iv: "ce7e5266105ee63798d96dd5839b7f9e"
server_key_version: "encryptionkey@0"
I20260808 18:42:56.484341 4095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:56.499285 4095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:56.502164 4095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:56.502393 4095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:56.509178 4095 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36811
I20260808 18:42:56.509218 4202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36811 every 8 connection(s)
I20260808 18:42:56.510149 4095 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:56.513101 4203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:56.514174 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4095
I20260808 18:42:56.514307 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:56.514586 4343 external_mini_cluster.cc:1428] Setting key 72b9a3f58592a6f59b6cd395b29c6317
I20260808 18:42:56.520059 4203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: Bootstrap starting.
I20260808 18:42:56.522585 4203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:56.523509 4203 log.cc:824] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:56.524780 4207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:56.515950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43399 (local address 127.0.0.1:36811)
0808 18:42:56.516388 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:56.516417 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:56.516462 (+ 45us) server_negotiation.cc:407] Connection header received
0808 18:42:56.517263 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:56.517290 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:56.517736 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:56.518134 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:56.518589 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:56.520060 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:56.521011 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:56.521705 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:56.521859 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:56.522687 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:56.522694 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:56.522711 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:56.523206 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:56.523275 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:56.523308 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:56.523422 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:56.523560 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 18:42:56.523942 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":113,"threads_started":1}
I20260808 18:42:56.525602 4203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: No bootstrap required, opened a new log
I20260808 18:42:56.527678 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:56.529605 4203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } }
I20260808 18:42:56.529887 4203 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:56.529959 4203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7942a6253d9c4affb325db4659157f9e, State: Initialized, Role: FOLLOWER
I20260808 18:42:56.530426 4203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } }
I20260808 18:42:56.530570 4203 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:56.530637 4203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:56.530740 4203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:56.531664 4203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } }
I20260808 18:42:56.532011 4203 leader_election.cc:302] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7942a6253d9c4affb325db4659157f9e; no voters:
I20260808 18:42:56.532310 4203 leader_election.cc:288] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:56.532408 4219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:56.532625 4219 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [term 1 LEADER]: Becoming Leader. State: Replica: 7942a6253d9c4affb325db4659157f9e, State: Running, Role: LEADER
I20260808 18:42:56.532990 4219 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } }
I20260808 18:42:56.533694 4203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:56.533740 4207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:56.529667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46855 (local address 127.0.0.1:36811)
0808 18:42:56.529774 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:56.529778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:56.529908 (+ 130us) server_negotiation.cc:407] Connection header received
0808 18:42:56.530067 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:56.530070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:56.530112 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:56.530174 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:56.530500 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:56.531060 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:56.532040 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:56.532319 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:56.532411 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:56.533328 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:56.533332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:56.533335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:56.533349 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:56.533380 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:56.533392 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:56.533456 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:56.533549 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 18:42:56.533601 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:42:56.535398 4220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7942a6253d9c4affb325db4659157f9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } } }
I20260808 18:42:56.535398 4221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7942a6253d9c4affb325db4659157f9e. Latest consensus state: current_term: 1 leader_uuid: "7942a6253d9c4affb325db4659157f9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7942a6253d9c4affb325db4659157f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36811 } } }
I20260808 18:42:56.535629 4221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:56.535614 4220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e [sys.catalog]: This master's current role is: LEADER
W20260808 18:42:56.538709 4242 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:42:56.538792 4242 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:42:56.538852 4241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:56.539535 4241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:56.545063 4241 catalog_manager.cc:1347] Generated new cluster ID: 85c4afb04dfc4632929419ea91f0ad26
I20260808 18:42:56.545145 4241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:56.571614 4241 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:56.572615 4241 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:56.582996 4241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7942a6253d9c4affb325db4659157f9e: Generated new TSK 0
I20260808 18:42:56.583910 4241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:56.588855 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4095
2026-08-08T18:42:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:56 dist-test-slave-fgb3 krb5kdc[4250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:56 dist-test-slave-fgb3 krb5kdc[4250](info): set up 2 sockets
Aug 08 18:42:56 dist-test-slave-fgb3 krb5kdc[4250](info): commencing operation
krb5kdc: starting...
W20260808 18:42:57.746774 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:57 dist-test-slave-fgb3 krb5kdc[4250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:57.870908 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35643
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:57.981707 4266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:57.981982 4266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:57.982023 4266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:57.985918 4266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:57.985977 4266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:57.985994 4266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:57.986009 4266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:57.986022 4266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:57.991215 4266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:57.992204 4266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:57.993170 4266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:58.001351 4280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:58.001359 4276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:58.001359 4277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:58.001703 4266 server_base.cc:1034] running on GCE node
I20260808 18:42:58.002236 4266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:58.003314 4266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:58.004458 4266 hybrid_clock.cc:648] HybridClock initialized: now 1786214578004438 us; error 33 us; skew 500 ppm
Aug 08 18:42:58 dist-test-slave-fgb3 krb5kdc[4250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214578, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:58.007148 4266 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:58.008073 4266 webserver.cc:460] Webserver started at http://127.0.0.1:46739/ using document root <none> and password file <none>
I20260808 18:42:58.008596 4266 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:58.008653 4266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:58.008826 4266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:58.010890 4266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "dc4f9467039f424da5e0a545b4f5f853"
format_stamp: "Formatted at 2026-08-08 18:42:58 on dist-test-slave-fgb3"
server_key: "8791d9e1d2eccee1e17fdde93e7db8cc"
server_key_iv: "8f21ac978fe0489066d6e8bdf75d1495"
server_key_version: "encryptionkey@0"
I20260808 18:42:58.011413 4266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "dc4f9467039f424da5e0a545b4f5f853"
format_stamp: "Formatted at 2026-08-08 18:42:58 on dist-test-slave-fgb3"
server_key: "8791d9e1d2eccee1e17fdde93e7db8cc"
server_key_iv: "8f21ac978fe0489066d6e8bdf75d1495"
server_key_version: "encryptionkey@0"
I20260808 18:42:58.015450 4266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 18:42:58.017802 4292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:58.019078 4266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:42:58.019191 4266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "dc4f9467039f424da5e0a545b4f5f853"
format_stamp: "Formatted at 2026-08-08 18:42:58 on dist-test-slave-fgb3"
server_key: "8791d9e1d2eccee1e17fdde93e7db8cc"
server_key_iv: "8f21ac978fe0489066d6e8bdf75d1495"
server_key_version: "encryptionkey@0"
I20260808 18:42:58.019296 4266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:58.023789 4266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:58.026800 4266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:58.026968 4266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:58.033514 4266 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35643
I20260808 18:42:58.033540 4375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35643 every 8 connection(s)
I20260808 18:42:58.034468 4266 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:58.037204 4377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:58.037436 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4266
I20260808 18:42:58.037588 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:58.037896 4343 external_mini_cluster.cc:1428] Setting key adbbf3cbf8c6e4cbcb55f7c3145792e6
I20260808 18:42:58.043181 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:58.039319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39737 (local address 127.0.0.1:35643)
0808 18:42:58.039712 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:58.039728 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:58.039765 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:42:58.040559 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:58.040580 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:58.040866 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:58.041147 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:58.041985 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:58.041990 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:58.042002 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:58.042013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:58.042069 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:58.042089 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:58.042195 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:58.042292 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 18:42:58.042474 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":102,"threads_started":1}
I20260808 18:42:58.044291 4377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853: Bootstrap starting.
I20260808 18:42:58.045959 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:58.046747 4377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:58.047504 4377 log.cc:824] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:58.049469 4377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853: No bootstrap required, opened a new log
I20260808 18:42:58.049628 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:58.048036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41377 (local address 127.0.0.1:35643)
0808 18:42:58.048154 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:58.048158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:58.048421 (+ 263us) server_negotiation.cc:407] Connection header received
0808 18:42:58.048524 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:58.048527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:58.048560 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:58.048624 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:58.049270 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:58.049274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:58.049277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:42:58.049289 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:58.049317 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:42:58.049329 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:58.049408 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:58.049476 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 18:42:58.049514 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 18:42:58.053208 4377 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } }
I20260808 18:42:58.053436 4377 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:58.053476 4377 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4f9467039f424da5e0a545b4f5f853, State: Initialized, Role: FOLLOWER
I20260808 18:42:58.053869 4377 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } }
I20260808 18:42:58.053997 4377 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:58.054041 4377 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:58.054113 4377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:58.055002 4377 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } }
I20260808 18:42:58.055318 4377 leader_election.cc:302] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc4f9467039f424da5e0a545b4f5f853; no voters:
I20260808 18:42:58.055567 4377 leader_election.cc:288] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:58.055670 4388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:58.055889 4388 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [term 1 LEADER]: Becoming Leader. State: Replica: dc4f9467039f424da5e0a545b4f5f853, State: Running, Role: LEADER
I20260808 18:42:58.056236 4388 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } }
I20260808 18:42:58.056722 4377 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:58.057818 4390 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc4f9467039f424da5e0a545b4f5f853. Latest consensus state: current_term: 1 leader_uuid: "dc4f9467039f424da5e0a545b4f5f853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } } }
I20260808 18:42:58.057941 4390 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:58.057898 4389 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc4f9467039f424da5e0a545b4f5f853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f9467039f424da5e0a545b4f5f853" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35643 } } }
I20260808 18:42:58.058012 4389 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853 [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:58.058434 4401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:58.062004 4401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:58.067883 4401 catalog_manager.cc:1347] Generated new cluster ID: 14e2e83e10824b4495dcffa4108d4853
I20260808 18:42:58.067966 4401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:58.098943 4401 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:58.099298 4401 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:58.107391 4401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc4f9467039f424da5e0a545b4f5f853: Generated new TSK 0
I20260808 18:42:58.108057 4401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:58.112071 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4266
2026-08-08T18:42:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1517 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:58 dist-test-slave-fgb3 krb5kdc[4419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:58 dist-test-slave-fgb3 krb5kdc[4419](info): set up 2 sockets
Aug 08 18:42:58 dist-test-slave-fgb3 krb5kdc[4419](info): commencing operation
krb5kdc: starting...
W20260808 18:42:59.246083 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:42:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:42:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:42:59.367026 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43903
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:42:59.478593 4446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:42:59.478868 4446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:42:59.478909 4446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:42:59.482918 4446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:42:59.482977 4446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:42:59.482995 4446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:42:59.483024 4446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:42:59.483052 4446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:42:59.488210 4446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:42:59.489233 4446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:42:59.490240 4446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:42:59.499045 4455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:42:59.499059 4463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:59.499159 4446 server_base.cc:1034] running on GCE node
W20260808 18:42:59.499059 4456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:42:59.499958 4446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:42:59.501145 4446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:42:59.502369 4446 hybrid_clock.cc:648] HybridClock initialized: now 1786214579502346 us; error 30 us; skew 500 ppm
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214579, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:42:59.513504 4446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:42:59.514567 4446 webserver.cc:460] Webserver started at http://127.0.0.1:39271/ using document root <none> and password file <none>
I20260808 18:42:59.515164 4446 fs_manager.cc:359] Metadata directory not provided
I20260808 18:42:59.515234 4446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:42:59.515451 4446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:42:59.517513 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "4d987e412c0e4413bb541ee35a7dde7e"
format_stamp: "Formatted at 2026-08-08 18:42:59 on dist-test-slave-fgb3"
server_key: "506e18a0b1d186864d8c1b171a1569d6"
server_key_iv: "d9b5e04279bb79fd73ba7213c8e0cff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:59.518076 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "4d987e412c0e4413bb541ee35a7dde7e"
format_stamp: "Formatted at 2026-08-08 18:42:59 on dist-test-slave-fgb3"
server_key: "506e18a0b1d186864d8c1b171a1569d6"
server_key_iv: "d9b5e04279bb79fd73ba7213c8e0cff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:59.521672 4446 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:42:59.524013 4472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:42:59.525134 4446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 18:42:59.525259 4446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "4d987e412c0e4413bb541ee35a7dde7e"
format_stamp: "Formatted at 2026-08-08 18:42:59 on dist-test-slave-fgb3"
server_key: "506e18a0b1d186864d8c1b171a1569d6"
server_key_iv: "d9b5e04279bb79fd73ba7213c8e0cff8"
server_key_version: "encryptionkey@0"
I20260808 18:42:59.525352 4446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:42:59.536940 4446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:42:59.539440 4446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:42:59.539609 4446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:42:59.546253 4446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43903
I20260808 18:42:59.546268 4546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43903 every 8 connection(s)
I20260808 18:42:59.547165 4446 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:42:59.549778 4547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:42:59.553467 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4446
I20260808 18:42:59.553592 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:42:59.553838 4343 external_mini_cluster.cc:1428] Setting key 7a44328a9bfbacac67a6313d303f43fc
I20260808 18:42:59.555346 4547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e: Bootstrap starting.
I20260808 18:42:59.557683 4547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e: Neither blocks nor log segments found. Creating new log.
I20260808 18:42:59.558440 4547 log.cc:824] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:42:59.560392 4547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e: No bootstrap required, opened a new log
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 18:42:59.564628 4547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260808 18:42:59.564905 4547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:42:59.564977 4547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d987e412c0e4413bb541ee35a7dde7e, State: Initialized, Role: FOLLOWER
I20260808 18:42:59.565403 4547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260808 18:42:59.565570 4547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:42:59.565644 4547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:42:59.565742 4547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:42:59.566766 4547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260808 18:42:59.567153 4547 leader_election.cc:302] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d987e412c0e4413bb541ee35a7dde7e; no voters:
I20260808 18:42:59.567474 4547 leader_election.cc:288] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:42:59.567552 4555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:42:59.567751 4555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [term 1 LEADER]: Becoming Leader. State: Replica: 4d987e412c0e4413bb541ee35a7dde7e, State: Running, Role: LEADER
I20260808 18:42:59.567970 4553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:59.555115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:49749 (local address 127.0.0.1:43903)
0808 18:42:59.555483 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:59.555498 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:59.555533 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:42:59.556155 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:59.556172 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:59.556493 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:59.556752 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:59.557621 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:59.558689 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:59.559790 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:59.560243 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:59.560351 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:59.563001 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:59.563008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:59.563026 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:59.563059 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:59.564806 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:59.565332 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:59.565337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:59.565343 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:59.565488 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:59.565856 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:59.565860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:59.565861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:59.566365 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:59.566593 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:59.566810 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 18:42:59.567028 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":98,"threads_started":1}
I20260808 18:42:59.568100 4555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } }
I20260808 18:42:59.568632 4547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:42:59.569695 4561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d987e412c0e4413bb541ee35a7dde7e. Latest consensus state: current_term: 1 leader_uuid: "4d987e412c0e4413bb541ee35a7dde7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } } }
I20260808 18:42:59.569801 4561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:59.570089 4556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d987e412c0e4413bb541ee35a7dde7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d987e412c0e4413bb541ee35a7dde7e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43903 } } }
I20260808 18:42:59.570164 4556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e [sys.catalog]: This master's current role is: LEADER
I20260808 18:42:59.570176 4571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:42:59.571341 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:42:59.573215 4571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:42:59.578759 4571 catalog_manager.cc:1347] Generated new cluster ID: 52b6b2aa6c854d03a1ea17646887a991
I20260808 18:42:59.578819 4571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:42:59.586678 4553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:42:59.574692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:35369 (local address 127.0.0.1:43903)
0808 18:42:59.574804 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 18:42:59.574809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:42:59.575651 (+ 842us) server_negotiation.cc:407] Connection header received
0808 18:42:59.575776 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:42:59.575779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:42:59.575828 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:42:59.575905 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:42:59.576693 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:59.577288 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:59.578452 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:42:59.578793 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:42:59.578892 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:42:59.583715 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:42:59.583719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:42:59.583722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:42:59.583746 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:42:59.585007 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:59.585454 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:59.585457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:59.585459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:59.585530 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:42:59.585835 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:42:59.585838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:42:59.585839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:42:59.586005 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:42:59.586133 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 18:42:59.586435 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 18:42:59.586524 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 18:42:59.590440 4571 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:42:59.591325 4571 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:42:59.597276 4571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d987e412c0e4413bb541ee35a7dde7e: Generated new TSK 0
I20260808 18:42:59.597988 4571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:42:59.606271 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4446
W20260808 18:42:59.624697 4415 connection.cc:535] client connection to 127.0.0.1:43903 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43903): Connection reset by peer (error 104)
2026-08-08T18:42:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1502 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4597](info): set up 2 sockets
Aug 08 18:42:59 dist-test-slave-fgb3 krb5kdc[4597](info): commencing operation
krb5kdc: starting...
W20260808 18:43:00.742494 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:00 dist-test-slave-fgb3 krb5kdc[4597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:43:00.865195 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37369
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:00.974370 4617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:00.974611 4617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:00.974651 4617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:00.978657 4617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:00.978713 4617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:00.978731 4617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:00.978747 4617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:00.978783 4617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:00.983845 4617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:00.984826 4617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:00.985824 4617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:00.994185 4631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:00.994216 4629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:00.994364 4617 server_base.cc:1034] running on GCE node
W20260808 18:43:00.994180 4633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:00.995119 4617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:00.996229 4617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:00.997397 4617 hybrid_clock.cc:648] HybridClock initialized: now 1786214580997382 us; error 32 us; skew 500 ppm
Aug 08 18:43:00 dist-test-slave-fgb3 krb5kdc[4597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214580, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:01.000128 4617 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:43:01.000957 4617 webserver.cc:460] Webserver started at http://127.0.0.1:41155/ using document root <none> and password file <none>
I20260808 18:43:01.001471 4617 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:01.001528 4617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:01.001694 4617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:01.003788 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "27d60b7fd2c6488897fac9202f3ed9ba"
format_stamp: "Formatted at 2026-08-08 18:43:00 on dist-test-slave-fgb3"
server_key: "37708d442bd914de31c66a333d8d4457"
server_key_iv: "70a0b2804b5bf011d0fe52163c3fb173"
server_key_version: "encryptionkey@0"
I20260808 18:43:01.004300 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "27d60b7fd2c6488897fac9202f3ed9ba"
format_stamp: "Formatted at 2026-08-08 18:43:00 on dist-test-slave-fgb3"
server_key: "37708d442bd914de31c66a333d8d4457"
server_key_iv: "70a0b2804b5bf011d0fe52163c3fb173"
server_key_version: "encryptionkey@0"
I20260808 18:43:01.007824 4617 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 18:43:01.010105 4642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:01.011286 4617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:43:01.011413 4617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "27d60b7fd2c6488897fac9202f3ed9ba"
format_stamp: "Formatted at 2026-08-08 18:43:00 on dist-test-slave-fgb3"
server_key: "37708d442bd914de31c66a333d8d4457"
server_key_iv: "70a0b2804b5bf011d0fe52163c3fb173"
server_key_version: "encryptionkey@0"
I20260808 18:43:01.011512 4617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:01.023188 4617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:01.026258 4617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:01.026479 4617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:01.033263 4617 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37369
I20260808 18:43:01.033286 4721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37369 every 8 connection(s)
I20260808 18:43:01.034204 4617 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:01.036983 4723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:01.040834 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4617
I20260808 18:43:01.040958 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:01.041206 4343 external_mini_cluster.cc:1428] Setting key 1d5aa76e01f33ef41bec401917a76e7d
I20260808 18:43:01.042794 4723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba: Bootstrap starting.
I20260808 18:43:01.044968 4723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:01.045727 4723 log.cc:824] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:01.047575 4723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba: No bootstrap required, opened a new log
I20260808 18:43:01.049790 4727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:01.042585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:38211 (local address 127.0.0.1:37369)
0808 18:43:01.043037 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:01.043053 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:01.043089 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:43:01.043720 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:01.043737 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:01.044067 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:01.044384 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:01.044789 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:01.045796 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:01.046740 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:01.047208 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:01.047350 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:01.048178 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:01.048184 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:01.048197 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:01.048575 (+ 378us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:01.048629 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:01.048652 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:01.048766 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:01.048951 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 18:43:01.049084 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260808 18:43:01.051220 4723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } }
I20260808 18:43:01.051501 4723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:01.051563 4723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27d60b7fd2c6488897fac9202f3ed9ba, State: Initialized, Role: FOLLOWER
I20260808 18:43:01.052045 4723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } }
I20260808 18:43:01.052194 4723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:01.052259 4723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:01.052361 4723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:01.052809 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:01.053488 4723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } }
I20260808 18:43:01.053865 4723 leader_election.cc:302] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27d60b7fd2c6488897fac9202f3ed9ba; no voters:
I20260808 18:43:01.054217 4723 leader_election.cc:288] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:01.054385 4732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:01.054622 4732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 27d60b7fd2c6488897fac9202f3ed9ba, State: Running, Role: LEADER
I20260808 18:43:01.055009 4732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } }
I20260808 18:43:01.055584 4723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:01.056315 4732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27d60b7fd2c6488897fac9202f3ed9ba. Latest consensus state: current_term: 1 leader_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } } }
I20260808 18:43:01.056494 4732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:01.056730 4743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27d60b7fd2c6488897fac9202f3ed9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37369 } } }
I20260808 18:43:01.056871 4743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:01.056931 4755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:01.060317 4727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:01.055176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:42569 (local address 127.0.0.1:37369)
0808 18:43:01.055294 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:01.055298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:01.055633 (+ 335us) server_negotiation.cc:407] Connection header received
0808 18:43:01.055788 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:01.055791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:01.055841 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:01.055922 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:01.056234 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:01.057078 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:01.058263 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:01.058646 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:01.058744 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:01.059785 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:01.059789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:01.059792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:01.059806 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:01.059836 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:01.059849 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:01.059937 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:01.060099 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 18:43:01.060140 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":30}
I20260808 18:43:01.060209 4755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:01.066381 4755 catalog_manager.cc:1347] Generated new cluster ID: 7850d29d44ca43228dc29f396fd30e8a
I20260808 18:43:01.066468 4755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:01.078385 4755 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:01.079313 4755 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:01.084026 4755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27d60b7fd2c6488897fac9202f3ed9ba: Generated new TSK 0
I20260808 18:43:01.084676 4755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:01.089553 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4617
W20260808 18:43:01.106920 4593 connection.cc:535] client connection to 127.0.0.1:37369 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37369): Connection reset by peer (error 104)
2026-08-08T18:43:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:01 dist-test-slave-fgb3 krb5kdc[4769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:01 dist-test-slave-fgb3 krb5kdc[4769](info): set up 2 sockets
Aug 08 18:43:01 dist-test-slave-fgb3 krb5kdc[4769](info): commencing operation
krb5kdc: starting...
W20260808 18:43:02.224028 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:02 dist-test-slave-fgb3 krb5kdc[4769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:43:02.345023 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39625
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:02.456152 4783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:02.456439 4783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:02.456498 4783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:02.460487 4783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:02.460551 4783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:02.460577 4783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:02.460599 4783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:02.460628 4783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:02.465839 4783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:02.466972 4783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:02.467983 4783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:02.476150 4792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:02.476138 4794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:02.476150 4791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:02.476394 4783 server_base.cc:1034] running on GCE node
I20260808 18:43:02.477007 4783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:02.478091 4783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:02.479260 4783 hybrid_clock.cc:648] HybridClock initialized: now 1786214582479234 us; error 30 us; skew 500 ppm
Aug 08 18:43:02 dist-test-slave-fgb3 krb5kdc[4769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214582, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:02.481905 4783 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:43:02.482815 4783 webserver.cc:460] Webserver started at http://127.0.0.1:35597/ using document root <none> and password file <none>
I20260808 18:43:02.483330 4783 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:02.483386 4783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:02.483554 4783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:02.485524 4783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "50113442c29e4ce8b52f113549c08a20"
format_stamp: "Formatted at 2026-08-08 18:43:02 on dist-test-slave-fgb3"
server_key: "a5c80eec4482b28f3cea1ada1b3d905b"
server_key_iv: "514d3d2f84614dd03fd0eac3682476fb"
server_key_version: "encryptionkey@0"
I20260808 18:43:02.486042 4783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "50113442c29e4ce8b52f113549c08a20"
format_stamp: "Formatted at 2026-08-08 18:43:02 on dist-test-slave-fgb3"
server_key: "a5c80eec4482b28f3cea1ada1b3d905b"
server_key_iv: "514d3d2f84614dd03fd0eac3682476fb"
server_key_version: "encryptionkey@0"
I20260808 18:43:02.489737 4783 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:43:02.492179 4801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:02.493386 4783 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:43:02.493491 4783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "50113442c29e4ce8b52f113549c08a20"
format_stamp: "Formatted at 2026-08-08 18:43:02 on dist-test-slave-fgb3"
server_key: "a5c80eec4482b28f3cea1ada1b3d905b"
server_key_iv: "514d3d2f84614dd03fd0eac3682476fb"
server_key_version: "encryptionkey@0"
I20260808 18:43:02.493587 4783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:02.498095 4783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:02.501147 4783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:02.501293 4783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:02.508226 4783 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39625
I20260808 18:43:02.508236 4894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39625 every 8 connection(s)
I20260808 18:43:02.509196 4783 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:02.510519 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4783
I20260808 18:43:02.510694 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:02.511049 4343 external_mini_cluster.cc:1428] Setting key 8fe224c66ea898a516c030f03117ba71
I20260808 18:43:02.512552 4895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:02.516042 4898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:02.512381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:38339 (local address 127.0.0.1:39625)
0808 18:43:02.512780 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:02.512796 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:02.512835 (+ 39us) server_negotiation.cc:407] Connection header received
0808 18:43:02.513496 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:02.513512 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:02.513791 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:02.514072 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:02.514865 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:02.514870 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:02.514882 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:02.514893 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:02.514948 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:02.514967 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:02.515074 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:02.515167 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 18:43:02.515338 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":115,"threads_started":1}
I20260808 18:43:02.518905 4895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: Bootstrap starting.
I20260808 18:43:02.519028 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:02.521215 4895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:02.522104 4895 log.cc:824] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:02.522607 4898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:02.521031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:44393 (local address 127.0.0.1:39625)
0808 18:43:02.521144 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:02.521148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:02.521327 (+ 179us) server_negotiation.cc:407] Connection header received
0808 18:43:02.521419 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:02.521421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:02.521459 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:02.521521 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:02.522185 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:02.522188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:02.522190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:02.522201 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:02.522232 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:02.522246 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:02.522338 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:02.522448 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 18:43:02.522484 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:43:02.524312 4895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: No bootstrap required, opened a new log
I20260808 18:43:02.527853 4895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260808 18:43:02.528076 4895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:02.528132 4895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50113442c29e4ce8b52f113549c08a20, State: Initialized, Role: FOLLOWER
I20260808 18:43:02.528535 4895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260808 18:43:02.528659 4895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:02.528725 4895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:02.528822 4895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:02.529668 4895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260808 18:43:02.529986 4895 leader_election.cc:302] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50113442c29e4ce8b52f113549c08a20; no voters:
I20260808 18:43:02.530268 4895 leader_election.cc:288] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:02.530404 4913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:02.530887 4913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [term 1 LEADER]: Becoming Leader. State: Replica: 50113442c29e4ce8b52f113549c08a20, State: Running, Role: LEADER
I20260808 18:43:02.531276 4913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260808 18:43:02.531564 4895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:02.532823 4916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50113442c29e4ce8b52f113549c08a20. Latest consensus state: current_term: 1 leader_uuid: "50113442c29e4ce8b52f113549c08a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } } }
I20260808 18:43:02.532961 4916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:02.533285 4915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50113442c29e4ce8b52f113549c08a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50113442c29e4ce8b52f113549c08a20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } } }
I20260808 18:43:02.533366 4915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20 [sys.catalog]: This master's current role is: LEADER
W20260808 18:43:02.536252 4930 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:02.536316 4930 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:02.536453 4926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:02.537123 4926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:02.542339 4926 catalog_manager.cc:1347] Generated new cluster ID: 8de8ef154caa434aa97d8f5cd4ae7a72
I20260808 18:43:02.542414 4926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:02.560180 4926 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:02.560528 4926 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:02.567622 4926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50113442c29e4ce8b52f113549c08a20: Generated new TSK 0
I20260808 18:43:02.568305 4926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:02.576874 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4783
2026-08-08T18:43:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:02 dist-test-slave-fgb3 krb5kdc[4939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:02 dist-test-slave-fgb3 krb5kdc[4939](info): set up 2 sockets
Aug 08 18:43:02 dist-test-slave-fgb3 krb5kdc[4939](info): commencing operation
krb5kdc: starting...
W20260808 18:43:03.721868 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:03 dist-test-slave-fgb3 krb5kdc[4939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:43:03.844560 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39755
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:03.953708 4959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:03.953949 4959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:03.954006 4959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:03.957896 4959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:03.957953 4959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:03.957996 4959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:03.958020 4959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:03.958048 4959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:03.963148 4959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39755
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:03.964135 4959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:03.965090 4959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:03.973107 4965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:03.973436 4959 server_base.cc:1034] running on GCE node
W20260808 18:43:03.973075 4969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:03.973071 4966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:03.974057 4959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:03.975137 4959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:03.976316 4959 hybrid_clock.cc:648] HybridClock initialized: now 1786214583976293 us; error 31 us; skew 500 ppm
Aug 08 18:43:03 dist-test-slave-fgb3 krb5kdc[4939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214583, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:03.978991 4959 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:43:03.979846 4959 webserver.cc:460] Webserver started at http://127.0.0.1:40299/ using document root <none> and password file <none>
I20260808 18:43:03.980386 4959 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:03.980453 4959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:03.980659 4959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:03.982721 4959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "8cbf040a1f244762a291edf76a9ad96e"
format_stamp: "Formatted at 2026-08-08 18:43:03 on dist-test-slave-fgb3"
server_key: "1ca4973004708221f9e9bb5fdb296238"
server_key_iv: "d0f87f829fdab8343205b2f64a6d01cc"
server_key_version: "encryptionkey@0"
I20260808 18:43:03.983278 4959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "8cbf040a1f244762a291edf76a9ad96e"
format_stamp: "Formatted at 2026-08-08 18:43:03 on dist-test-slave-fgb3"
server_key: "1ca4973004708221f9e9bb5fdb296238"
server_key_iv: "d0f87f829fdab8343205b2f64a6d01cc"
server_key_version: "encryptionkey@0"
I20260808 18:43:03.986937 4959 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:43:03.989233 4979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:03.990468 4959 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:43:03.990582 4959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "8cbf040a1f244762a291edf76a9ad96e"
format_stamp: "Formatted at 2026-08-08 18:43:03 on dist-test-slave-fgb3"
server_key: "1ca4973004708221f9e9bb5fdb296238"
server_key_iv: "d0f87f829fdab8343205b2f64a6d01cc"
server_key_version: "encryptionkey@0"
I20260808 18:43:03.990681 4959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:04.004297 4959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:04.006968 4959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:04.007143 4959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:04.013618 4959 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39755
I20260808 18:43:04.013659 5055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39755 every 8 connection(s)
I20260808 18:43:04.014612 4959 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:04.017361 5056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:04.020790 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 4959
I20260808 18:43:04.020936 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:04.021219 4343 external_mini_cluster.cc:1428] Setting key 368ebd1a2e5aa80bd3c39175f1034812
I20260808 18:43:04.023530 5056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: Bootstrap starting.
I20260808 18:43:04.026232 5056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:04.027103 5056 log.cc:824] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:04.029213 5056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: No bootstrap required, opened a new log
Aug 08 18:43:04 dist-test-slave-fgb3 krb5kdc[4939](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 18:43:04.033473 5056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } }
I20260808 18:43:04.033754 5056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:04.033820 5056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbf040a1f244762a291edf76a9ad96e, State: Initialized, Role: FOLLOWER
I20260808 18:43:04.034294 5056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } }
I20260808 18:43:04.034484 5056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:04.034559 5056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:04.034659 5056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:04.035784 5056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } }
I20260808 18:43:04.036159 5056 leader_election.cc:302] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cbf040a1f244762a291edf76a9ad96e; no voters:
I20260808 18:43:04.036513 5056 leader_election.cc:288] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:04.036633 5072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:04.036834 5072 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [term 1 LEADER]: Becoming Leader. State: Replica: 8cbf040a1f244762a291edf76a9ad96e, State: Running, Role: LEADER
I20260808 18:43:04.036947 5069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:04.022678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:51465 (local address 127.0.0.1:39755)
0808 18:43:04.023128 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:04.023147 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:04.023190 (+ 43us) server_negotiation.cc:407] Connection header received
0808 18:43:04.024003 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:04.024027 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:04.024453 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:04.024821 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:04.025502 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:04.026995 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:04.028090 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:04.028759 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:04.028915 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:04.031651 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:04.031658 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:04.031676 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:04.031706 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:04.033635 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:04.034194 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:04.034199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:04.034205 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:04.034366 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:04.034751 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:04.034754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:04.034756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:04.035255 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:04.035484 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:04.035724 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 18:43:04.035960 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":123,"threads_started":1}
I20260808 18:43:04.037217 5072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } }
I20260808 18:43:04.037788 5056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:04.039012 5073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cbf040a1f244762a291edf76a9ad96e. Latest consensus state: current_term: 1 leader_uuid: "8cbf040a1f244762a291edf76a9ad96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } } }
I20260808 18:43:04.039409 5073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:04.039305 5074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cbf040a1f244762a291edf76a9ad96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbf040a1f244762a291edf76a9ad96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39755 } } }
I20260808 18:43:04.039738 5074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:04.040663 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 18:43:04.043417 5092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:04.043491 5092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:04.043571 5091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:04.044265 5091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:04.049754 5091 catalog_manager.cc:1347] Generated new cluster ID: b77471db37c444ef8f69f274ab24cda9
I20260808 18:43:04.049815 5091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:04.054988 5069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:04.046883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:38097 (local address 127.0.0.1:39755)
0808 18:43:04.046993 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:04.046998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:04.047277 (+ 279us) server_negotiation.cc:407] Connection header received
0808 18:43:04.047407 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:04.047410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:04.047465 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:04.047549 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:04.048311 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:04.049118 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:04.050174 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:04.050500 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:04.050593 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:04.051977 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:04.051981 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:04.051983 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:04.052008 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:04.053285 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:04.053750 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:04.053753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:04.053754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:04.053824 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:04.054124 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:04.054128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:04.054130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:04.054295 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:04.054463 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:04.054741 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 18:43:04.054833 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":42}
I20260808 18:43:04.063750 5091 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:04.064651 5091 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:04.080338 5091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cbf040a1f244762a291edf76a9ad96e: Generated new TSK 0
I20260808 18:43:04.081286 5091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:04.084980 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 4959
W20260808 18:43:04.114589 4936 connection.cc:535] client connection to 127.0.0.1:39755 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39755): Connection reset by peer (error 104)
2026-08-08T18:43:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1525 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:04 dist-test-slave-fgb3 krb5kdc[5108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:04 dist-test-slave-fgb3 krb5kdc[5108](info): set up 2 sockets
Aug 08 18:43:04 dist-test-slave-fgb3 krb5kdc[5108](info): commencing operation
krb5kdc: starting...
W20260808 18:43:05.237280 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:05 dist-test-slave-fgb3 krb5kdc[5108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:43:05.359210 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:05.469674 5125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:05.469956 5125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:05.470016 5125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:05.473985 5125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:05.474050 5125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:05.474076 5125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:05.474097 5125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:05.474116 5125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:05.479427 5125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:05.480525 5125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:05.481570 5125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:05.489848 5133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:05.489835 5134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:05.489809 5125 server_base.cc:1034] running on GCE node
W20260808 18:43:05.489835 5137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:05.490639 5125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:05.491784 5125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:05.492969 5125 hybrid_clock.cc:648] HybridClock initialized: now 1786214585492948 us; error 35 us; skew 500 ppm
Aug 08 18:43:05 dist-test-slave-fgb3 krb5kdc[5108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214585, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:05.501690 5125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:43:05.502815 5125 webserver.cc:460] Webserver started at http://127.0.0.1:42955/ using document root <none> and password file <none>
I20260808 18:43:05.503427 5125 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:05.503504 5125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:05.503721 5125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:05.505962 5125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "e9e3f67bbecc4f7b82cb20506ed4a113"
format_stamp: "Formatted at 2026-08-08 18:43:05 on dist-test-slave-fgb3"
server_key: "ac970073545c11fb7a0fc6ff30a12264"
server_key_iv: "31b81f0ef798714efe099490930910ad"
server_key_version: "encryptionkey@0"
I20260808 18:43:05.506583 5125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "e9e3f67bbecc4f7b82cb20506ed4a113"
format_stamp: "Formatted at 2026-08-08 18:43:05 on dist-test-slave-fgb3"
server_key: "ac970073545c11fb7a0fc6ff30a12264"
server_key_iv: "31b81f0ef798714efe099490930910ad"
server_key_version: "encryptionkey@0"
I20260808 18:43:05.510367 5125 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 18:43:05.512748 5148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:05.513906 5125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:43:05.514021 5125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "e9e3f67bbecc4f7b82cb20506ed4a113"
format_stamp: "Formatted at 2026-08-08 18:43:05 on dist-test-slave-fgb3"
server_key: "ac970073545c11fb7a0fc6ff30a12264"
server_key_iv: "31b81f0ef798714efe099490930910ad"
server_key_version: "encryptionkey@0"
I20260808 18:43:05.514112 5125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:05.542279 5125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:05.545173 5125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:05.545360 5125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:05.552307 5125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37917
I20260808 18:43:05.552320 5220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37917 every 8 connection(s)
I20260808 18:43:05.553222 5125 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:05.555946 5221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:05.556103 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5125
I20260808 18:43:05.556233 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:05.556553 4343 external_mini_cluster.cc:1428] Setting key 86bd2a597e763bd15025ecd51a8b084e
I20260808 18:43:05.562682 5221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: Bootstrap starting.
I20260808 18:43:05.565053 5221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:05.565390 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:05.557855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:52823 (local address 127.0.0.1:37917)
0808 18:43:05.558261 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:05.558277 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:05.558340 (+ 63us) server_negotiation.cc:407] Connection header received
0808 18:43:05.559157 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:05.559178 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:05.559532 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:05.559807 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:05.560159 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:05.561124 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:05.562282 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:05.562805 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:05.562921 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:05.563764 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:05.563769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:05.563781 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:05.564141 (+ 360us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:05.564194 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:05.564217 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:05.564313 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:05.564490 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 18:43:05.564621 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":130,"threads_started":1}
I20260808 18:43:05.565797 5221 log.cc:824] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:05.567715 5221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: No bootstrap required, opened a new log
I20260808 18:43:05.568109 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:05.571319 5221 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } }
I20260808 18:43:05.571544 5221 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:05.571601 5221 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e3f67bbecc4f7b82cb20506ed4a113, State: Initialized, Role: FOLLOWER
I20260808 18:43:05.571988 5221 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } }
I20260808 18:43:05.572117 5221 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:05.572182 5221 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:05.572278 5221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:05.573189 5221 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } }
I20260808 18:43:05.573520 5221 leader_election.cc:302] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9e3f67bbecc4f7b82cb20506ed4a113; no voters:
I20260808 18:43:05.573734 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:05.569961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:34127 (local address 127.0.0.1:37917)
0808 18:43:05.570058 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:05.570062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:05.570238 (+ 176us) server_negotiation.cc:407] Connection header received
0808 18:43:05.570387 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:05.570390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:05.570432 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:05.570492 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:05.570735 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:05.571230 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:05.572129 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:05.572466 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:05.572549 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:05.573304 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:05.573308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:05.573311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:05.573323 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:05.573349 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:05.573361 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:05.573436 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:05.573583 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 18:43:05.573614 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 18:43:05.573827 5221 leader_election.cc:288] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:05.573918 5237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:05.574148 5237 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [term 1 LEADER]: Becoming Leader. State: Replica: e9e3f67bbecc4f7b82cb20506ed4a113, State: Running, Role: LEADER
I20260808 18:43:05.574540 5237 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } }
I20260808 18:43:05.575091 5221 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:05.576411 5239 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9e3f67bbecc4f7b82cb20506ed4a113. Latest consensus state: current_term: 1 leader_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } } }
I20260808 18:43:05.576440 5240 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9e3f67bbecc4f7b82cb20506ed4a113" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37917 } } }
I20260808 18:43:05.576609 5239 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:05.576617 5240 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113 [sys.catalog]: This master's current role is: LEADER
W20260808 18:43:05.579890 5268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:05.579972 5268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:05.580093 5264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:05.580798 5264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:05.585906 5264 catalog_manager.cc:1347] Generated new cluster ID: 8b5929744b0e4980a1aba17e038a4472
I20260808 18:43:05.585963 5264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:05.611735 5264 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:05.612703 5264 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:05.616801 5264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9e3f67bbecc4f7b82cb20506ed4a113: Generated new TSK 0
I20260808 18:43:05.617501 5264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:05.631501 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5125
W20260808 18:43:05.642452 5105 connection.cc:535] client connection to 127.0.0.1:37917 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37917): Connection reset by peer (error 104)
2026-08-08T18:43:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:05 dist-test-slave-fgb3 krb5kdc[5282](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:05 dist-test-slave-fgb3 krb5kdc[5282](info): set up 2 sockets
Aug 08 18:43:05 dist-test-slave-fgb3 krb5kdc[5282](info): commencing operation
krb5kdc: starting...
W20260808 18:43:06.781052 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:06 dist-test-slave-fgb3 krb5kdc[5282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 18:43:06.905006 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37337
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:07.014557 5301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:07.014799 5301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:07.014854 5301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:07.018714 5301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:07.018767 5301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:07.018795 5301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:07.018814 5301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:07.018841 5301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:07.023953 5301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37337
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:07.024981 5301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:07.025969 5301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:07.034042 5312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:07.034020 5314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:07.034031 5311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:07.034225 5301 server_base.cc:1034] running on GCE node
I20260808 18:43:07.034825 5301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:07.035830 5301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:07.036986 5301 hybrid_clock.cc:648] HybridClock initialized: now 1786214587036968 us; error 28 us; skew 500 ppm
Aug 08 18:43:07 dist-test-slave-fgb3 krb5kdc[5282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214587, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:07.039577 5301 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 18:43:07.040445 5301 webserver.cc:460] Webserver started at http://127.0.0.1:36713/ using document root <none> and password file <none>
I20260808 18:43:07.040937 5301 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:07.040992 5301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:07.041152 5301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:07.043159 5301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "1ae3badbee15494cb6abbb4e54323800"
format_stamp: "Formatted at 2026-08-08 18:43:07 on dist-test-slave-fgb3"
server_key: "97b7b954311029f112697615cd353035"
server_key_iv: "e2df8c014919cec63bcf70557d57267a"
server_key_version: "encryptionkey@0"
I20260808 18:43:07.043682 5301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "1ae3badbee15494cb6abbb4e54323800"
format_stamp: "Formatted at 2026-08-08 18:43:07 on dist-test-slave-fgb3"
server_key: "97b7b954311029f112697615cd353035"
server_key_iv: "e2df8c014919cec63bcf70557d57267a"
server_key_version: "encryptionkey@0"
I20260808 18:43:07.047175 5301 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:43:07.049594 5326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:07.050829 5301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:43:07.050940 5301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "1ae3badbee15494cb6abbb4e54323800"
format_stamp: "Formatted at 2026-08-08 18:43:07 on dist-test-slave-fgb3"
server_key: "97b7b954311029f112697615cd353035"
server_key_iv: "e2df8c014919cec63bcf70557d57267a"
server_key_version: "encryptionkey@0"
I20260808 18:43:07.051024 5301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:07.055259 5301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:07.058091 5301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:07.058228 5301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:07.064949 5301 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37337
I20260808 18:43:07.064960 5401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37337 every 8 connection(s)
I20260808 18:43:07.065850 5301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:07.068706 5403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:07.070891 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5301
I20260808 18:43:07.071013 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:07.071305 4343 external_mini_cluster.cc:1428] Setting key bd9d937e1b3a03db38435c3fe71f1a1f
I20260808 18:43:07.074831 5403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800: Bootstrap starting.
I20260808 18:43:07.076404 5409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:07.072707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:59077 (local address 127.0.0.1:37337)
0808 18:43:07.073143 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:07.073159 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:07.073195 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:43:07.073828 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:07.073844 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:07.074133 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:07.074441 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:07.075247 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:07.075252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:07.075263 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:07.075273 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:07.075324 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:07.075343 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:07.075447 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:07.075549 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 18:43:07.075699 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":133,"threads_started":1}
I20260808 18:43:07.077390 5403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:07.078167 5403 log.cc:824] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:07.079344 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:07.080180 5403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800: No bootstrap required, opened a new log
I20260808 18:43:07.082823 5409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:07.081330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:57269 (local address 127.0.0.1:37337)
0808 18:43:07.081450 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:07.081454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:07.081619 (+ 165us) server_negotiation.cc:407] Connection header received
0808 18:43:07.081747 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:07.081749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:07.081777 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:07.081842 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:07.082494 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:07.082497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:07.082499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:07.082509 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:07.082532 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:07.082542 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:07.082607 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:07.082695 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 18:43:07.082725 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 18:43:07.084211 5403 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } }
I20260808 18:43:07.084460 5403 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:07.084530 5403 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ae3badbee15494cb6abbb4e54323800, State: Initialized, Role: FOLLOWER
I20260808 18:43:07.084939 5403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } }
I20260808 18:43:07.085073 5403 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:07.085139 5403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:07.085246 5403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:07.086136 5403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } }
I20260808 18:43:07.086506 5403 leader_election.cc:302] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ae3badbee15494cb6abbb4e54323800; no voters:
I20260808 18:43:07.086797 5403 leader_election.cc:288] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:07.086917 5422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:07.087141 5422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [term 1 LEADER]: Becoming Leader. State: Replica: 1ae3badbee15494cb6abbb4e54323800, State: Running, Role: LEADER
I20260808 18:43:07.087498 5422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } }
I20260808 18:43:07.088088 5403 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:07.089257 5425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ae3badbee15494cb6abbb4e54323800. Latest consensus state: current_term: 1 leader_uuid: "1ae3badbee15494cb6abbb4e54323800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } } }
I20260808 18:43:07.089279 5423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ae3badbee15494cb6abbb4e54323800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae3badbee15494cb6abbb4e54323800" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37337 } } }
I20260808 18:43:07.089377 5425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:07.089377 5423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:07.089769 5438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:07.092828 5438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:07.098417 5438 catalog_manager.cc:1347] Generated new cluster ID: 1794d2d52c944985b88cb6d8089911c3
I20260808 18:43:07.098490 5438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:07.133745 5438 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:07.134086 5438 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:07.139478 5438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ae3badbee15494cb6abbb4e54323800: Generated new TSK 0
I20260808 18:43:07.140142 5438 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:07.150455 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5301
2026-08-08T18:43:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:07 dist-test-slave-fgb3 krb5kdc[5463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:07 dist-test-slave-fgb3 krb5kdc[5463](info): set up 2 sockets
Aug 08 18:43:07 dist-test-slave-fgb3 krb5kdc[5463](info): commencing operation
krb5kdc: starting...
W20260808 18:43:08.294442 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:08.419026 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:46181
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:42723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:46181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:08.531387 5488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:08.531656 5488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:08.531713 5488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:08.535658 5488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:08.535717 5488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:08.535742 5488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:08.535764 5488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:08.535790 5488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:08.541013 5488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:42723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:46181
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:46181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:08.542083 5488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:08.543134 5488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:08.551764 5501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:08.552028 5488 server_base.cc:1034] running on GCE node
W20260808 18:43:08.551772 5498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:08.551777 5499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:08.552856 5488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:08.553956 5488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:08.555112 5488 hybrid_clock.cc:648] HybridClock initialized: now 1786214588555092 us; error 32 us; skew 500 ppm
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214588, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:08.557997 5488 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:08.558964 5488 webserver.cc:460] Webserver started at http://127.4.61.254:36333/ using document root <none> and password file <none>
I20260808 18:43:08.559505 5488 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:08.559566 5488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:08.559734 5488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:08.561774 5488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "01f458f9ef184ff186f9d8849bf80554"
format_stamp: "Formatted at 2026-08-08 18:43:08 on dist-test-slave-fgb3"
server_key: "d7c2581cff54a4c3e36bc141bcfef603"
server_key_iv: "8a1df7345bcd067b19b5214f20a1ff71"
server_key_version: "encryptionkey@0"
I20260808 18:43:08.562341 5488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "01f458f9ef184ff186f9d8849bf80554"
format_stamp: "Formatted at 2026-08-08 18:43:08 on dist-test-slave-fgb3"
server_key: "d7c2581cff54a4c3e36bc141bcfef603"
server_key_iv: "8a1df7345bcd067b19b5214f20a1ff71"
server_key_version: "encryptionkey@0"
I20260808 18:43:08.566047 5488 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:43:08.568558 5512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:08.569837 5488 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 18:43:08.569958 5488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "01f458f9ef184ff186f9d8849bf80554"
format_stamp: "Formatted at 2026-08-08 18:43:08 on dist-test-slave-fgb3"
server_key: "d7c2581cff54a4c3e36bc141bcfef603"
server_key_iv: "8a1df7345bcd067b19b5214f20a1ff71"
server_key_version: "encryptionkey@0"
I20260808 18:43:08.570063 5488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:08.589645 5488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:08.592957 5488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:08.593153 5488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:08.600359 5488 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:46181
I20260808 18:43:08.600381 5610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:46181 every 8 connection(s)
I20260808 18:43:08.601541 5488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:08.604593 5611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:08.606395 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5488
I20260808 18:43:08.606530 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:08.606791 4343 external_mini_cluster.cc:1428] Setting key fde87236d57e8ee9c941eb6b96d4dc29
I20260808 18:43:08.611037 5611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: Bootstrap starting.
I20260808 18:43:08.613298 5611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:08.614085 5611 log.cc:824] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:08.616070 5611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: No bootstrap required, opened a new log
I20260808 18:43:08.619712 5611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } }
I20260808 18:43:08.619958 5611 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:08.620035 5611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f458f9ef184ff186f9d8849bf80554, State: Initialized, Role: FOLLOWER
I20260808 18:43:08.620523 5611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } }
I20260808 18:43:08.620674 5611 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:08.620749 5611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:08.620862 5611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:08.621307 5616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:08.608231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46231 (local address 127.4.61.254:46181)
0808 18:43:08.608713 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:08.608730 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:08.608766 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:43:08.609424 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:08.609442 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:08.609777 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:08.610099 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:08.611005 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:08.612010 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:08.612885 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:08.613363 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:08.613511 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:08.616122 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:08.616127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:08.616141 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:08.616174 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:08.617939 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:08.618581 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:08.618587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:08.618592 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:08.618729 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:08.619107 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:08.619109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:08.619110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:08.619545 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:08.619791 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:08.620142 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 18:43:08.620402 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":147,"threads_started":1}
I20260808 18:43:08.621886 5611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } }
I20260808 18:43:08.622257 5611 leader_election.cc:302] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01f458f9ef184ff186f9d8849bf80554; no voters:
I20260808 18:43:08.622617 5611 leader_election.cc:288] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:08.622730 5620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:08.622991 5620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [term 1 LEADER]: Becoming Leader. State: Replica: 01f458f9ef184ff186f9d8849bf80554, State: Running, Role: LEADER
I20260808 18:43:08.623356 5620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } }
I20260808 18:43:08.623924 5611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:08.624639 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:08.627198 5622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01f458f9ef184ff186f9d8849bf80554. Latest consensus state: current_term: 1 leader_uuid: "01f458f9ef184ff186f9d8849bf80554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } } }
I20260808 18:43:08.626854 5621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01f458f9ef184ff186f9d8849bf80554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f458f9ef184ff186f9d8849bf80554" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 46181 } } }
I20260808 18:43:08.627360 5621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:08.627625 5622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554 [sys.catalog]: This master's current role is: LEADER
W20260808 18:43:08.629783 5650 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:08.629890 5650 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:08.629990 5652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:08.630918 5652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:08.635357 5616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:08.627244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38531 (local address 127.4.61.254:46181)
0808 18:43:08.627338 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:08.627343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:08.627974 (+ 631us) server_negotiation.cc:407] Connection header received
0808 18:43:08.628102 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:08.628105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:08.628144 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:08.628207 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:08.628998 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:08.629751 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:08.630720 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:08.630953 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:08.631042 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:08.632376 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:08.632379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:08.632381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:08.632403 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:08.633670 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:08.634132 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:08.634135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:08.634136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:08.634207 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:08.634553 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:08.634556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:08.634557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:08.634720 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:08.634845 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:08.635113 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 18:43:08.635201 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 18:43:08.637223 5652 catalog_manager.cc:1347] Generated new cluster ID: 9b4982a4e5eb468ba463d33705222bff
I20260808 18:43:08.637287 5652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:08.666827 5652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:08.668077 5652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:08.673444 5652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01f458f9ef184ff186f9d8849bf80554: Generated new TSK 0
I20260808 18:43:08.674185 5652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:08.681628 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5488
W20260808 18:43:08.696019 5460 connection.cc:535] client connection to 127.4.61.254:46181 recv error: Network error: failed to read from TLS socket (remote: 127.4.61.254:46181): Connection reset by peer (error 104)
2026-08-08T18:43:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1533 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5666](info): set up 2 sockets
Aug 08 18:43:08 dist-test-slave-fgb3 krb5kdc[5666](info): commencing operation
krb5kdc: starting...
W20260808 18:43:09.819259 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:09 dist-test-slave-fgb3 krb5kdc[5666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:09.941502 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35333
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:35333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:10.052436 5687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:10.052739 5687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:10.052801 5687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:10.056942 5687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:10.057022 5687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:10.057051 5687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:10.057073 5687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:10.057099 5687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:10.062530 5687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:35333
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:35333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:10.063656 5687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:10.064685 5687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:10.073180 5695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:10.073239 5702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:10.073302 5687 server_base.cc:1034] running on GCE node
W20260808 18:43:10.073479 5697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:10.074034 5687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:10.075155 5687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:10.076310 5687 hybrid_clock.cc:648] HybridClock initialized: now 1786214590076298 us; error 25 us; skew 500 ppm
Aug 08 18:43:10 dist-test-slave-fgb3 krb5kdc[5666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214590, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:10.079018 5687 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:10.079913 5687 webserver.cc:460] Webserver started at http://127.4.61.254:38997/ using document root <none> and password file <none>
I20260808 18:43:10.080438 5687 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:10.080495 5687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:10.080681 5687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:10.082741 5687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "496a09a4375f40399b05af88fccafb33"
format_stamp: "Formatted at 2026-08-08 18:43:10 on dist-test-slave-fgb3"
server_key: "76451505de836c8f8cb5c8ec5c4a9062"
server_key_iv: "f1b80f2522b6672be6609268fb9b5134"
server_key_version: "encryptionkey@0"
I20260808 18:43:10.083267 5687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "496a09a4375f40399b05af88fccafb33"
format_stamp: "Formatted at 2026-08-08 18:43:10 on dist-test-slave-fgb3"
server_key: "76451505de836c8f8cb5c8ec5c4a9062"
server_key_iv: "f1b80f2522b6672be6609268fb9b5134"
server_key_version: "encryptionkey@0"
I20260808 18:43:10.086930 5687 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:43:10.089329 5712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:10.090664 5687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 18:43:10.090795 5687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "496a09a4375f40399b05af88fccafb33"
format_stamp: "Formatted at 2026-08-08 18:43:10 on dist-test-slave-fgb3"
server_key: "76451505de836c8f8cb5c8ec5c4a9062"
server_key_iv: "f1b80f2522b6672be6609268fb9b5134"
server_key_version: "encryptionkey@0"
I20260808 18:43:10.090899 5687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:10.104815 5687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:10.108105 5687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:10.108299 5687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:10.115211 5687 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:35333
I20260808 18:43:10.115236 5805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:35333 every 8 connection(s)
I20260808 18:43:10.116220 5687 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:10.117976 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5687
I20260808 18:43:10.118127 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:10.118495 4343 external_mini_cluster.cc:1428] Setting key 5c6f3f2ff4a946a5a69fe2c67660ba48
I20260808 18:43:10.119602 5806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:10.126068 5806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: Bootstrap starting.
I20260808 18:43:10.127676 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:10.119871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46049 (local address 127.4.61.254:35333)
0808 18:43:10.120298 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:10.120314 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:10.120351 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:43:10.120992 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:10.121008 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:10.121339 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:10.121623 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:10.121999 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:10.123047 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:10.124355 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:10.124843 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:10.124969 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:10.125897 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:10.125903 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:10.125916 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:10.126404 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:10.126469 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:10.126493 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:10.126592 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:10.126774 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 18:43:10.126909 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":117,"threads_started":1}
I20260808 18:43:10.128625 5806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:10.129361 5806 log.cc:824] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:10.130764 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:10.131727 5806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: No bootstrap required, opened a new log
I20260808 18:43:10.136229 5806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } }
I20260808 18:43:10.136555 5806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:10.136619 5806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496a09a4375f40399b05af88fccafb33, State: Initialized, Role: FOLLOWER
I20260808 18:43:10.137179 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:10.133070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49627 (local address 127.4.61.254:35333)
0808 18:43:10.133181 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:10.133184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:10.133303 (+ 119us) server_negotiation.cc:407] Connection header received
0808 18:43:10.133415 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:10.133418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:10.133462 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:10.133542 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:10.133750 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:10.134579 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:10.135421 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:10.135752 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:10.135858 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:10.136708 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:10.136712 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:10.136714 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:10.136728 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:10.136754 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:10.136779 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:10.136856 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:10.137007 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 18:43:10.137049 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 18:43:10.137149 5806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } }
I20260808 18:43:10.137324 5806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:10.137403 5806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:10.137521 5806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:10.138662 5806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } }
I20260808 18:43:10.139025 5806 leader_election.cc:302] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 496a09a4375f40399b05af88fccafb33; no voters:
I20260808 18:43:10.139349 5806 leader_election.cc:288] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:10.139443 5821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:10.139650 5821 raft_consensus.cc:686] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [term 1 LEADER]: Becoming Leader. State: Replica: 496a09a4375f40399b05af88fccafb33, State: Running, Role: LEADER
I20260808 18:43:10.140003 5821 consensus_queue.cc:237] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } }
I20260808 18:43:10.140638 5806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:10.141688 5823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 496a09a4375f40399b05af88fccafb33. Latest consensus state: current_term: 1 leader_uuid: "496a09a4375f40399b05af88fccafb33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } } }
I20260808 18:43:10.141822 5823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:10.142180 5822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "496a09a4375f40399b05af88fccafb33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496a09a4375f40399b05af88fccafb33" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 35333 } } }
I20260808 18:43:10.142359 5822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33 [sys.catalog]: This master's current role is: LEADER
W20260808 18:43:10.145884 5843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:10.145982 5843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:10.146071 5831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:10.146831 5831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:10.152930 5831 catalog_manager.cc:1347] Generated new cluster ID: f280ae06b97e4cc69b34ce0faa0f9ede
I20260808 18:43:10.153002 5831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:10.168026 5831 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:10.168992 5831 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:10.174497 5831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 496a09a4375f40399b05af88fccafb33: Generated new TSK 0
I20260808 18:43:10.175195 5831 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:10.181339 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5687
W20260808 18:43:10.199260 5660 connection.cc:535] client connection to 127.4.61.254:35333 recv error: Network error: failed to read from TLS socket (remote: 127.4.61.254:35333): Connection reset by peer (error 104)
2026-08-08T18:43:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:10 dist-test-slave-fgb3 krb5kdc[5851](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:10 dist-test-slave-fgb3 krb5kdc[5851](info): set up 2 sockets
Aug 08 18:43:10 dist-test-slave-fgb3 krb5kdc[5851](info): commencing operation
krb5kdc: starting...
W20260808 18:43:11.315497 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:11 dist-test-slave-fgb3 krb5kdc[5851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:11.441514 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43519
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:33363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:43519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:11.552165 5867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:11.552425 5867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:11.552465 5867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:11.556375 5867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:11.556429 5867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:11.556447 5867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:11.556461 5867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:11.556475 5867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:11.561730 5867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:33363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:43519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:43519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:11.562783 5867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:11.563747 5867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:11.571696 5876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:11.571724 5877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:11.571724 5880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:11.571847 5867 server_base.cc:1034] running on GCE node
I20260808 18:43:11.572433 5867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:11.573419 5867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:11.574576 5867 hybrid_clock.cc:648] HybridClock initialized: now 1786214591574562 us; error 27 us; skew 500 ppm
Aug 08 18:43:11 dist-test-slave-fgb3 krb5kdc[5851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214591, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:11.581158 5867 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:11.582020 5867 webserver.cc:460] Webserver started at http://127.4.61.254:41945/ using document root <none> and password file <none>
I20260808 18:43:11.582576 5867 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:11.582644 5867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:11.582846 5867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:11.584824 5867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "433a58ff72e4481caeff791a650c0d19"
format_stamp: "Formatted at 2026-08-08 18:43:11 on dist-test-slave-fgb3"
server_key: "fc3c4b525dab37a300718f71843863d3"
server_key_iv: "7a8c5489a38d95ff95cb3429b62c03ec"
server_key_version: "encryptionkey@0"
I20260808 18:43:11.585381 5867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "433a58ff72e4481caeff791a650c0d19"
format_stamp: "Formatted at 2026-08-08 18:43:11 on dist-test-slave-fgb3"
server_key: "fc3c4b525dab37a300718f71843863d3"
server_key_iv: "7a8c5489a38d95ff95cb3429b62c03ec"
server_key_version: "encryptionkey@0"
I20260808 18:43:11.589020 5867 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 18:43:11.591393 5890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:11.592535 5867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:43:11.592653 5867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "433a58ff72e4481caeff791a650c0d19"
format_stamp: "Formatted at 2026-08-08 18:43:11 on dist-test-slave-fgb3"
server_key: "fc3c4b525dab37a300718f71843863d3"
server_key_iv: "7a8c5489a38d95ff95cb3429b62c03ec"
server_key_version: "encryptionkey@0"
I20260808 18:43:11.592751 5867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:11.597295 5867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:11.600281 5867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:11.600457 5867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:11.607262 5867 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:43519
I20260808 18:43:11.607350 5965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:43519 every 8 connection(s)
I20260808 18:43:11.608212 5867 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:11.611037 5967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:11.616941 5967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19: Bootstrap starting.
I20260808 18:43:11.618237 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 5867
I20260808 18:43:11.618395 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:11.618702 4343 external_mini_cluster.cc:1428] Setting key d616617877811d892a5ba55bae1249f9
I20260808 18:43:11.619871 5967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:11.620704 5967 log.cc:824] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:11.622754 5967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19: No bootstrap required, opened a new log
I20260808 18:43:11.623790 5972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:11.619903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33045 (local address 127.4.61.254:43519)
0808 18:43:11.620382 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:11.620398 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:11.620433 (+ 35us) server_negotiation.cc:407] Connection header received
0808 18:43:11.621128 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:11.621152 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:11.621511 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:11.621824 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:11.622617 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:11.622622 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:11.622634 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:11.622644 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:11.622695 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:11.622714 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:11.622810 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:11.622965 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 18:43:11.623116 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":148,"threads_started":1}
I20260808 18:43:11.626633 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:11.626845 5967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } }
I20260808 18:43:11.627080 5967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:11.627148 5967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 433a58ff72e4481caeff791a650c0d19, State: Initialized, Role: FOLLOWER
I20260808 18:43:11.627581 5967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } }
I20260808 18:43:11.627725 5967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:11.627836 5967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:11.627977 5967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:11.629089 5967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } }
I20260808 18:43:11.629452 5967 leader_election.cc:302] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 433a58ff72e4481caeff791a650c0d19; no voters:
I20260808 18:43:11.629808 5967 leader_election.cc:288] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:11.629904 5980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:11.630154 5980 raft_consensus.cc:686] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [term 1 LEADER]: Becoming Leader. State: Replica: 433a58ff72e4481caeff791a650c0d19, State: Running, Role: LEADER
I20260808 18:43:11.630292 5972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:11.628646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32979 (local address 127.4.61.254:43519)
0808 18:43:11.628748 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:11.628752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:11.628917 (+ 165us) server_negotiation.cc:407] Connection header received
0808 18:43:11.629028 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:11.629031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:11.629063 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:11.629128 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:11.629827 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:11.629840 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:11.629843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:11.629856 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:11.629886 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:11.629900 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:11.629988 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:11.630138 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 18:43:11.630182 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 18:43:11.630716 5980 consensus_queue.cc:237] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } }
I20260808 18:43:11.631170 5967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:11.631791 5980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 433a58ff72e4481caeff791a650c0d19. Latest consensus state: current_term: 1 leader_uuid: "433a58ff72e4481caeff791a650c0d19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } } }
I20260808 18:43:11.631978 5980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:11.632207 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "433a58ff72e4481caeff791a650c0d19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433a58ff72e4481caeff791a650c0d19" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 43519 } } }
I20260808 18:43:11.632373 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:11.632391 5994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:11.635651 5994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:11.641355 5994 catalog_manager.cc:1347] Generated new cluster ID: d2d036b7e66940f98a2acff453d391fa
I20260808 18:43:11.641465 5994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:11.661613 5994 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:11.661981 5994 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:11.667071 5994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 433a58ff72e4481caeff791a650c0d19: Generated new TSK 0
I20260808 18:43:11.667816 5994 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:11.675367 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 5867
2026-08-08T18:43:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:11 dist-test-slave-fgb3 krb5kdc[6013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:11 dist-test-slave-fgb3 krb5kdc[6013](info): set up 2 sockets
Aug 08 18:43:11 dist-test-slave-fgb3 krb5kdc[6013](info): commencing operation
krb5kdc: starting...
W20260808 18:43:12.807691 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:12 dist-test-slave-fgb3 krb5kdc[6013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:12.936888 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40655
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:35955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:40655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:13.047221 6031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:13.047497 6031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:13.047537 6031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:13.051437 6031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:13.051498 6031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:13.051517 6031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:13.051532 6031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:13.051545 6031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:13.056768 6031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:35955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:40655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:40655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:13.057833 6031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:13.058928 6031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:13.067622 6044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:13.067615 6039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:13.067621 6038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:13.067972 6031 server_base.cc:1034] running on GCE node
I20260808 18:43:13.068533 6031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:13.069628 6031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:13.070788 6031 hybrid_clock.cc:648] HybridClock initialized: now 1786214593070769 us; error 33 us; skew 500 ppm
Aug 08 18:43:13 dist-test-slave-fgb3 krb5kdc[6013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214593, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:13.073498 6031 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:13.074388 6031 webserver.cc:460] Webserver started at http://127.4.61.254:41099/ using document root <none> and password file <none>
I20260808 18:43:13.074929 6031 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:13.074995 6031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:13.075181 6031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:13.077184 6031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "517d934cf0854e33836f6fa47ce1b803"
format_stamp: "Formatted at 2026-08-08 18:43:13 on dist-test-slave-fgb3"
server_key: "1e6697dbd51198df04196e7755c3b65d"
server_key_iv: "7444942942d45bb8731dcc6f15fc9bdc"
server_key_version: "encryptionkey@0"
I20260808 18:43:13.077742 6031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "517d934cf0854e33836f6fa47ce1b803"
format_stamp: "Formatted at 2026-08-08 18:43:13 on dist-test-slave-fgb3"
server_key: "1e6697dbd51198df04196e7755c3b65d"
server_key_iv: "7444942942d45bb8731dcc6f15fc9bdc"
server_key_version: "encryptionkey@0"
I20260808 18:43:13.081451 6031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:43:13.083937 6051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:13.085179 6031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:43:13.085345 6031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "517d934cf0854e33836f6fa47ce1b803"
format_stamp: "Formatted at 2026-08-08 18:43:13 on dist-test-slave-fgb3"
server_key: "1e6697dbd51198df04196e7755c3b65d"
server_key_iv: "7444942942d45bb8731dcc6f15fc9bdc"
server_key_version: "encryptionkey@0"
I20260808 18:43:13.085456 6031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:13.097645 6031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:13.100965 6031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:13.101166 6031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:13.108698 6031 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:40655
I20260808 18:43:13.109221 6121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:40655 every 8 connection(s)
I20260808 18:43:13.109925 6031 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:13.113624 6122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:13.113986 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6031
I20260808 18:43:13.114123 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:13.114552 4343 external_mini_cluster.cc:1428] Setting key 344cbdf1ff3bb2f52e33445d7fe99c77
I20260808 18:43:13.121281 6122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: Bootstrap starting.
I20260808 18:43:13.124037 6122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:13.124917 6122 log.cc:824] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: Log is configured to *not* fsync() on all Append() calls
Aug 08 18:43:13 dist-test-slave-fgb3 krb5kdc[6013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:13.127311 6122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: No bootstrap required, opened a new log
I20260808 18:43:13.131484 6122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } }
I20260808 18:43:13.131723 6122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:13.131768 6122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517d934cf0854e33836f6fa47ce1b803, State: Initialized, Role: FOLLOWER
I20260808 18:43:13.132192 6122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } }
I20260808 18:43:13.132370 6122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:13.132458 6122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:13.132570 6122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:13.133649 6122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } }
I20260808 18:43:13.134019 6122 leader_election.cc:302] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 517d934cf0854e33836f6fa47ce1b803; no voters:
I20260808 18:43:13.134788 6125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:13.117718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35465 (local address 127.4.61.254:40655)
0808 18:43:13.118363 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:13.118384 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:13.118430 (+ 46us) server_negotiation.cc:407] Connection header received
0808 18:43:13.119291 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:13.119318 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:13.119748 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:13.120139 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:13.121035 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:13.122574 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:13.123724 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:13.124466 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:13.124661 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:13.127651 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:13.127659 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:13.127678 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:13.127716 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:13.130288 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:13.130825 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:13.130832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:13.130839 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:13.131012 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:13.131357 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:13.131361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:13.131363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:13.132130 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:13.132548 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:13.132778 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 18:43:13.133144 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":152,"threads_started":1}
I20260808 18:43:13.137017 6122 leader_election.cc:288] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:13.137235 6129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:13.138274 6129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [term 1 LEADER]: Becoming Leader. State: Replica: 517d934cf0854e33836f6fa47ce1b803, State: Running, Role: LEADER
I20260808 18:43:13.138708 6129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } }
I20260808 18:43:13.139192 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:13.139428 6122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:13.139991 6129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 517d934cf0854e33836f6fa47ce1b803. Latest consensus state: current_term: 1 leader_uuid: "517d934cf0854e33836f6fa47ce1b803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } } }
I20260808 18:43:13.140123 6129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:13.140417 6130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "517d934cf0854e33836f6fa47ce1b803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517d934cf0854e33836f6fa47ce1b803" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 40655 } } }
I20260808 18:43:13.140513 6130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803 [sys.catalog]: This master's current role is: LEADER
W20260808 18:43:13.144510 6154 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:13.144594 6154 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:13.144676 6137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:13.145491 6137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:13.152232 6137 catalog_manager.cc:1347] Generated new cluster ID: a3c8f815fdf040e2987e8b9f169851a9
I20260808 18:43:13.152288 6137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:13.153085 6125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:13.142476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41405 (local address 127.4.61.254:40655)
0808 18:43:13.142579 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:13.142584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:13.142601 (+ 17us) server_negotiation.cc:407] Connection header received
0808 18:43:13.142762 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:13.142766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:13.142813 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:13.142897 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:13.143776 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:13.144537 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:13.145650 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:13.145968 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:13.146042 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:13.147811 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:13.147816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:13.147818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:13.147847 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:13.150943 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:13.151423 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:13.151427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:13.151428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:13.151516 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:13.151843 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:13.151847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:13.151849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:13.152072 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:13.152190 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:13.152810 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 18:43:13.152943 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 18:43:13.164495 6137 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:13.165884 6137 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:13.184665 6137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 517d934cf0854e33836f6fa47ce1b803: Generated new TSK 0
I20260808 18:43:13.185371 6137 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:13.195793 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6031
2026-08-08T18:43:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:13 dist-test-slave-fgb3 krb5kdc[6166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:13 dist-test-slave-fgb3 krb5kdc[6166](info): set up 2 sockets
Aug 08 18:43:13 dist-test-slave-fgb3 krb5kdc[6166](info): commencing operation
krb5kdc: starting...
W20260808 18:43:14.331461 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:14 dist-test-slave-fgb3 krb5kdc[6166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:14.454900 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33929
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:40967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:33929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:14.568377 6189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:14.568639 6189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:14.568679 6189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:14.572690 6189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:14.572755 6189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:14.572774 6189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:14.572791 6189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:14.572805 6189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:14.578130 6189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:40967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:33929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:33929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:14.579205 6189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:14.580205 6189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:14.588604 6194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:14.588662 6195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:14.588747 6189 server_base.cc:1034] running on GCE node
W20260808 18:43:14.588652 6197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:14.589421 6189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:14.590571 6189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:14.591732 6189 hybrid_clock.cc:648] HybridClock initialized: now 1786214594591710 us; error 33 us; skew 500 ppm
Aug 08 18:43:14 dist-test-slave-fgb3 krb5kdc[6166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214594, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:14.594425 6189 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:14.595281 6189 webserver.cc:460] Webserver started at http://127.4.61.254:33297/ using document root <none> and password file <none>
I20260808 18:43:14.595817 6189 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:14.595885 6189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:14.596092 6189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:14.598109 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "da13b610775d4109a9039e9b94ae56ca"
format_stamp: "Formatted at 2026-08-08 18:43:14 on dist-test-slave-fgb3"
server_key: "4c95d617e4b26c834fd714a50904d128"
server_key_iv: "be4b759108eed12aff4e35b30377dd3f"
server_key_version: "encryptionkey@0"
I20260808 18:43:14.598690 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "da13b610775d4109a9039e9b94ae56ca"
format_stamp: "Formatted at 2026-08-08 18:43:14 on dist-test-slave-fgb3"
server_key: "4c95d617e4b26c834fd714a50904d128"
server_key_iv: "be4b759108eed12aff4e35b30377dd3f"
server_key_version: "encryptionkey@0"
I20260808 18:43:14.602344 6189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:43:14.604691 6204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:14.605881 6189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:43:14.605996 6189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "da13b610775d4109a9039e9b94ae56ca"
format_stamp: "Formatted at 2026-08-08 18:43:14 on dist-test-slave-fgb3"
server_key: "4c95d617e4b26c834fd714a50904d128"
server_key_iv: "be4b759108eed12aff4e35b30377dd3f"
server_key_version: "encryptionkey@0"
I20260808 18:43:14.606091 6189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:14.650281 6189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:14.653509 6189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:14.653697 6189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:14.660547 6189 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:33929
I20260808 18:43:14.660579 6273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:33929 every 8 connection(s)
I20260808 18:43:14.661494 6189 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:14.662252 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6189
I20260808 18:43:14.662433 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:14.662755 4343 external_mini_cluster.cc:1428] Setting key 66bffc3dce9846a965fd3e8f232efb02
I20260808 18:43:14.664932 6274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:14.670288 6274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca: Bootstrap starting.
I20260808 18:43:14.671273 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:14.664131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34713 (local address 127.4.61.254:33929)
0808 18:43:14.664600 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:14.664619 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:14.664655 (+ 36us) server_negotiation.cc:407] Connection header received
0808 18:43:14.665322 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:14.665340 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:14.665671 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:14.665974 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:14.666436 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:14.667429 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:14.668298 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:14.668763 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:14.668907 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:14.669665 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:14.669670 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:14.669682 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:14.670054 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:14.670105 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:14.670127 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:14.670212 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:14.670373 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 18:43:14.670585 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":171,"threads_started":1}
I20260808 18:43:14.672660 6274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:14.673460 6274 log.cc:824] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:14.673964 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:14.675665 6274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca: No bootstrap required, opened a new log
I20260808 18:43:14.679903 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:14.676154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60569 (local address 127.4.61.254:33929)
0808 18:43:14.676265 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:14.676270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:14.676476 (+ 206us) server_negotiation.cc:407] Connection header received
0808 18:43:14.676551 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:14.676554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:14.676596 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:14.676681 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:14.676876 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:14.677619 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:14.678407 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:14.678740 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:14.678839 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:14.679531 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:14.679535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:14.679538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:14.679551 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:14.679578 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:14.679591 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:14.679666 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:14.679719 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 18:43:14.679766 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 18:43:14.680030 6274 raft_consensus.cc:348] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } }
I20260808 18:43:14.680259 6274 raft_consensus.cc:374] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:14.680315 6274 raft_consensus.cc:729] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da13b610775d4109a9039e9b94ae56ca, State: Initialized, Role: FOLLOWER
I20260808 18:43:14.680740 6274 consensus_queue.cc:260] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } }
I20260808 18:43:14.680871 6274 raft_consensus.cc:388] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:14.680933 6274 raft_consensus.cc:482] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:14.681026 6274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:14.681862 6274 raft_consensus.cc:504] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } }
I20260808 18:43:14.682178 6274 leader_election.cc:302] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da13b610775d4109a9039e9b94ae56ca; no voters:
I20260808 18:43:14.682477 6274 leader_election.cc:288] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:14.682622 6289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:14.682878 6289 raft_consensus.cc:686] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [term 1 LEADER]: Becoming Leader. State: Replica: da13b610775d4109a9039e9b94ae56ca, State: Running, Role: LEADER
I20260808 18:43:14.683209 6289 consensus_queue.cc:237] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } }
I20260808 18:43:14.683616 6274 sys_catalog.cc:564] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:14.684772 6291 sys_catalog.cc:455] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader da13b610775d4109a9039e9b94ae56ca. Latest consensus state: current_term: 1 leader_uuid: "da13b610775d4109a9039e9b94ae56ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } } }
I20260808 18:43:14.684904 6291 sys_catalog.cc:458] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:14.685230 6290 sys_catalog.cc:455] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da13b610775d4109a9039e9b94ae56ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b610775d4109a9039e9b94ae56ca" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 33929 } } }
I20260808 18:43:14.685321 6290 sys_catalog.cc:458] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:14.685340 6300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:14.688580 6300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:14.694195 6300 catalog_manager.cc:1347] Generated new cluster ID: 4e5b3f4e3a8b4a20ac293424b5cb69c7
I20260808 18:43:14.694278 6300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:14.726444 6300 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:14.727432 6300 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:14.733196 6300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da13b610775d4109a9039e9b94ae56ca: Generated new TSK 0
I20260808 18:43:14.733920 6300 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:14.741882 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6189
2026-08-08T18:43:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1542 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:14 dist-test-slave-fgb3 krb5kdc[6313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:14 dist-test-slave-fgb3 krb5kdc[6313](info): set up 2 sockets
Aug 08 18:43:14 dist-test-slave-fgb3 krb5kdc[6313](info): commencing operation
krb5kdc: starting...
W20260808 18:43:15.872825 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:15 dist-test-slave-fgb3 krb5kdc[6313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:15.995420 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37409
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:44637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:37409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:16.109589 6328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:16.109864 6328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:16.109922 6328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:16.113889 6328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:16.113958 6328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:16.113984 6328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:16.114004 6328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:16.114024 6328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:16.119315 6328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:44637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:37409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:37409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:16.120432 6328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:16.121457 6328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:16.129793 6336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:16.129793 6339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:16.129793 6334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:16.130208 6328 server_base.cc:1034] running on GCE node
I20260808 18:43:16.130795 6328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:16.131923 6328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:16.133085 6328 hybrid_clock.cc:648] HybridClock initialized: now 1786214596133069 us; error 28 us; skew 500 ppm
Aug 08 18:43:16 dist-test-slave-fgb3 krb5kdc[6313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214596, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:16.135803 6328 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:16.136679 6328 webserver.cc:460] Webserver started at http://127.4.61.254:45295/ using document root <none> and password file <none>
I20260808 18:43:16.137228 6328 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:16.137291 6328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:16.137491 6328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:16.139564 6328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "72827e1b65a74a2e98b9ab4903dde299"
format_stamp: "Formatted at 2026-08-08 18:43:16 on dist-test-slave-fgb3"
server_key: "653378d45be6ed3420b1ded311cbc850"
server_key_iv: "3ff081bf01d22c01af8a7b549fca79bb"
server_key_version: "encryptionkey@0"
I20260808 18:43:16.140122 6328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "72827e1b65a74a2e98b9ab4903dde299"
format_stamp: "Formatted at 2026-08-08 18:43:16 on dist-test-slave-fgb3"
server_key: "653378d45be6ed3420b1ded311cbc850"
server_key_iv: "3ff081bf01d22c01af8a7b549fca79bb"
server_key_version: "encryptionkey@0"
I20260808 18:43:16.143743 6328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 18:43:16.146087 6350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:16.147338 6328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:43:16.147451 6328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "72827e1b65a74a2e98b9ab4903dde299"
format_stamp: "Formatted at 2026-08-08 18:43:16 on dist-test-slave-fgb3"
server_key: "653378d45be6ed3420b1ded311cbc850"
server_key_iv: "3ff081bf01d22c01af8a7b549fca79bb"
server_key_version: "encryptionkey@0"
I20260808 18:43:16.147554 6328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:16.152259 6328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:16.155289 6328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:16.155465 6328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:16.162227 6328 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:37409
I20260808 18:43:16.162236 6425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:37409 every 8 connection(s)
I20260808 18:43:16.163188 6328 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:16.165910 6426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:16.171522 6426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299: Bootstrap starting.
I20260808 18:43:16.172142 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6328
I20260808 18:43:16.172274 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:16.172561 4343 external_mini_cluster.cc:1428] Setting key 4f1952fe71ccc71e0a9bf4f93be1e27a
I20260808 18:43:16.174351 6426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:16.175084 6426 log.cc:824] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:16.177109 6426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299: No bootstrap required, opened a new log
I20260808 18:43:16.177646 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:16.173815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57913 (local address 127.4.61.254:37409)
0808 18:43:16.174244 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:16.174259 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:16.174296 (+ 37us) server_negotiation.cc:407] Connection header received
0808 18:43:16.174993 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:16.175012 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:16.175318 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:16.175642 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:16.176413 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:16.176418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:16.176430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:16.176441 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:16.176495 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:16.176515 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:16.176610 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:16.176738 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 18:43:16.176894 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":116,"threads_started":1}
I20260808 18:43:16.180294 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:16.180809 6426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } }
I20260808 18:43:16.181038 6426 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 18:43:16.181097 6426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72827e1b65a74a2e98b9ab4903dde299, State: Initialized, Role: FOLLOWER
I20260808 18:43:16.181499 6426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } }
I20260808 18:43:16.181654 6426 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 18:43:16.181718 6426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 18:43:16.181814 6426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:16.182909 6426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } }
I20260808 18:43:16.183281 6426 leader_election.cc:302] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72827e1b65a74a2e98b9ab4903dde299; no voters:
I20260808 18:43:16.183629 6426 leader_election.cc:288] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 18:43:16.183701 6438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:16.183887 6438 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [term 1 LEADER]: Becoming Leader. State: Replica: 72827e1b65a74a2e98b9ab4903dde299, State: Running, Role: LEADER
I20260808 18:43:16.183995 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:16.182295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48987 (local address 127.4.61.254:37409)
0808 18:43:16.182419 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:16.182423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:16.182672 (+ 249us) server_negotiation.cc:407] Connection header received
0808 18:43:16.182787 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:16.182789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:16.182817 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:16.182878 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:16.183520 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:16.183523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:16.183525 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 18:43:16.183536 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:16.183559 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 18:43:16.183569 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:16.183644 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:16.183807 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 18:43:16.183847 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:43:16.184213 6438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } }
I20260808 18:43:16.184906 6426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:16.185405 6438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72827e1b65a74a2e98b9ab4903dde299" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } } }
I20260808 18:43:16.185531 6438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:16.185722 6438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72827e1b65a74a2e98b9ab4903dde299. Latest consensus state: current_term: 1 leader_uuid: "72827e1b65a74a2e98b9ab4903dde299" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72827e1b65a74a2e98b9ab4903dde299" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 37409 } } }
I20260808 18:43:16.185808 6438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:16.185967 6445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:16.189217 6445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:16.194367 6445 catalog_manager.cc:1347] Generated new cluster ID: 5ee69932c0ff4ab68a89ab9ec8ffc74a
I20260808 18:43:16.194430 6445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:16.212067 6445 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:16.212417 6445 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:16.217727 6445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72827e1b65a74a2e98b9ab4903dde299: Generated new TSK 0
I20260808 18:43:16.218575 6445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 18:43:16.227869 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6328
2026-08-08T18:43:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1483 ms)
[----------] 18 tests from AuthTokenIssuingTest (27222 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:16 dist-test-slave-fgb3 krb5kdc[6478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:16 dist-test-slave-fgb3 krb5kdc[6478](info): set up 2 sockets
Aug 08 18:43:16 dist-test-slave-fgb3 krb5kdc[6478](info): commencing operation
krb5kdc: starting...
W20260808 18:43:17.389895 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:17.509003 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:39071
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:17.618177 6501 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:17.618462 6501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:17.618485 6501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:17.618523 6501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:17.622326 6501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:17.622377 6501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:17.622394 6501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:17.622408 6501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:17.622421 6501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:17.627465 6501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:39071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:17.628448 6501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:17.629400 6501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:17.637884 6512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:17.637880 6516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:17.637902 6509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:17.638204 6501 server_base.cc:1034] running on GCE node
I20260808 18:43:17.638801 6501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:17.639904 6501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:17.641055 6501 hybrid_clock.cc:648] HybridClock initialized: now 1786214597641032 us; error 36 us; skew 500 ppm
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:17.646546 6501 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:17.647480 6501 webserver.cc:460] Webserver started at http://127.4.61.254:38181/ using document root <none> and password file <none>
I20260808 18:43:17.648025 6501 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:17.648093 6501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:17.648295 6501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:17.650295 6501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "2170b10a7d57498c8fde4b1208026fef"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "7cb89fb888f101eb297f43dcc60b073f"
server_key_iv: "389af5fb59f49ee3dcb3fcde0e2ba630"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.650884 6501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "2170b10a7d57498c8fde4b1208026fef"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "7cb89fb888f101eb297f43dcc60b073f"
server_key_iv: "389af5fb59f49ee3dcb3fcde0e2ba630"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.654388 6501 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 18:43:17.656698 6525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:17.657848 6501 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:43:17.657960 6501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "2170b10a7d57498c8fde4b1208026fef"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "7cb89fb888f101eb297f43dcc60b073f"
server_key_iv: "389af5fb59f49ee3dcb3fcde0e2ba630"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.658064 6501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:17.679174 6501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:17.681851 6501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:17.682036 6501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:17.688629 6501 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:39071
I20260808 18:43:17.688887 6615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:39071 every 8 connection(s)
I20260808 18:43:17.689553 6501 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:17.692313 6616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:17.695416 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6501
I20260808 18:43:17.695549 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:17.695855 4343 external_mini_cluster.cc:1428] Setting key 5692b592a2db2bc1035569f6ec212d15
I20260808 18:43:17.697458 6616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.61.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.253@KRBTEST.COM" created.
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:17.714993 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.702968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56080 (local address 127.4.61.254:39071)
0808 18:43:17.703281 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:17.703292 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:17.703320 (+ 28us) server_negotiation.cc:407] Connection header received
0808 18:43:17.703482 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:17.703487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:17.703734 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:17.703943 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:17.704999 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.705940 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.706969 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.707345 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.707462 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.710358 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:17.710381 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:17.710391 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:17.710412 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:17.712103 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.712594 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.712598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.712600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.712700 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.713018 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.713020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.713021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.713362 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:17.713480 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:17.713910 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 18:43:17.714162 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":209,"thread_start_us":123,"threads_started":1}
I20260808 18:43:17.714998 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.700213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:39071 (local address 127.0.0.1:56080)
0808 18:43:17.701394 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.701467 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:17.702741 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:17.704038 (+ 1297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:17.704044 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:17.704525 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:17.704842 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.704858 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.706057 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.706060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.706837 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.706847 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.707499 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.707503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.707602 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.708083 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:17.708099 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:17.710204 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:17.712207 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.712215 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.712223 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.712496 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.712784 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.712787 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.712789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.712939 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.713494 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:17.713501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:17.713663 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 18:43:17.713848 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 18:43:17.714252 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":84,"thread_start_us":739,"threads_started":1}
I20260808 18:43:17.717348 6616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:17.718053 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.717808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48034)
0808 18:43:17.717917 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.717996 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 18:43:17.718240 6531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
I20260808 18:43:17.719045 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.718828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48046)
0808 18:43:17.718937 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.718987 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 18:43:17.719162 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:45541: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
I20260808 18:43:17.724507 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:45541
--webserver_interface=127.4.61.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:43:17.768404 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } attempt: 1
I20260808 18:43:17.769294 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.768998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48054)
0808 18:43:17.769147 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.769211 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 18:43:17.770016 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.769789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48064)
0808 18:43:17.769908 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.769953 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 18:43:17.770170 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:45541: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
I20260808 18:43:17.838347 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } attempt: 2
W20260808 18:43:17.840437 6624 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:17.840858 6624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:17.840930 6624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:17.841012 6624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 18:43:17.842935 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.842617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48076)
0808 18:43:17.842769 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.842840 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 18:43:17.843741 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.843522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48092)
0808 18:43:17.843627 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.843677 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 18:43:17.843931 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:45541: Network error: Client connection negotiation failed: client connection to 127.4.61.253:45541: connect: Connection refused (error 111)
W20260808 18:43:17.846588 6624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:17.846647 6624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:17.846666 6624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:17.846681 6624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:17.846695 6624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:17.852149 6624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:45541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.61.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:17.853299 6624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:17.854378 6624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:17.862780 6637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:17.862793 6633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:17.862788 6634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:17.862998 6624 server_base.cc:1034] running on GCE node
I20260808 18:43:17.863616 6624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:17.864713 6624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:17.865911 6624 hybrid_clock.cc:648] HybridClock initialized: now 1786214597865889 us; error 32 us; skew 500 ppm
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:17.868629 6624 init.cc:377] Logged in from keytab as kudu/127.4.61.253@KRBTEST.COM (short username kudu)
I20260808 18:43:17.869520 6624 webserver.cc:460] Webserver started at http://127.4.61.253:37521/ using document root <none> and password file <none>
I20260808 18:43:17.870080 6624 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:17.870148 6624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:17.870427 6624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:17.872529 6624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data/instance:
uuid: "2b98785300ca4de4b3e16b9b9bf148ca"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "6bd288a73e4e5af91e8fe0aec3ff1710"
server_key_iv: "046ff0d6f4657e76c37487cd3b633ffa"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.873085 6624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal/instance:
uuid: "2b98785300ca4de4b3e16b9b9bf148ca"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "6bd288a73e4e5af91e8fe0aec3ff1710"
server_key_iv: "046ff0d6f4657e76c37487cd3b633ffa"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.876803 6624 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 18:43:17.879282 6645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:17.880535 6624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 18:43:17.880650 6624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "2b98785300ca4de4b3e16b9b9bf148ca"
format_stamp: "Formatted at 2026-08-08 18:43:17 on dist-test-slave-fgb3"
server_key: "6bd288a73e4e5af91e8fe0aec3ff1710"
server_key_iv: "046ff0d6f4657e76c37487cd3b633ffa"
server_key_version: "encryptionkey@0"
I20260808 18:43:17.880746 6624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:17.903927 6624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:17.907086 6624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:17.907284 6624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:17.914088 6624 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.253:45541
I20260808 18:43:17.914425 6724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.253:45541 every 8 connection(s)
I20260808 18:43:17.915134 6624 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
I20260808 18:43:17.917946 6725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:17.922050 6725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:17.923877 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6624
I20260808 18:43:17.924000 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-1/wal/instance
I20260808 18:43:17.924312 4343 external_mini_cluster.cc:1428] Setting key 41f8a28d146470d334a5ca84e9d53d3a
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.252@KRBTEST.COM; defaulting to no policy
I20260808 18:43:17.935096 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.252@KRBTEST.COM" created.
I20260808 18:43:17.936129 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.924053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56096 (local address 127.4.61.254:39071)
0808 18:43:17.924214 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:17.924220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:17.925130 (+ 910us) server_negotiation.cc:407] Connection header received
0808 18:43:17.926267 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:17.926271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:17.926363 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:17.926457 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:17.927596 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.928324 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.929502 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.929862 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.929980 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.932404 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:17.932407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:17.932409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:17.932435 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:17.933874 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.934372 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.934376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.934378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.934458 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.934785 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.934789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.934790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.934990 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:17.935101 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:17.935832 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 18:43:17.935969 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 18:43:17.937600 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.924444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:39071 (local address 127.0.0.1:56096)
0808 18:43:17.924953 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.925010 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:17.926024 (+ 1014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:17.926623 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:17.926629 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:17.926961 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:17.927447 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.927461 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.928451 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.928453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.929368 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.929378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.929995 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.929997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.930131 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.930684 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:17.930701 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:17.932206 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:17.933991 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.933996 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.934009 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.934260 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.934530 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.934532 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.934533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.934664 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.935093 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:17.935100 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:17.935513 (+ 413us) client_negotiation.cc:769] Sending connection context
0808 18:43:17.936296 (+ 783us) client_negotiation.cc:240] Negotiation successful
0808 18:43:17.936641 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":134,"threads_started":1}
I20260808 18:43:17.940054 6725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:17.945549 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.935550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48094)
0808 18:43:17.935768 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.935783 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:17.935862 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:17.936747 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:17.936750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:17.936912 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:17.937027 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.937034 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.938302 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.938305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.939101 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.939111 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.939952 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.939956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.940054 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.940549 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:17.940561 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:17.942010 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:17.943886 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.943889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.943891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.944154 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.944481 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.944484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.944486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.944582 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.945115 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:17.945118 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:17.945210 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 18:43:17.945275 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 18:43:17.945392 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 18:43:17.946157 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.935637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48094 (local address 127.4.61.253:45541)
0808 18:43:17.936318 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:17.936330 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:17.936352 (+ 22us) server_negotiation.cc:407] Connection header received
0808 18:43:17.936392 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:17.936398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:17.936598 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:17.936738 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:17.937140 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.938192 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.939223 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.939780 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.940283 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.942166 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:17.942177 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:17.942191 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:17.942232 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:17.943771 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.944275 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.944282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.944284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.944385 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.944677 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.944680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.944682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.944981 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:17.945796 (+ 815us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:17.945909 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 18:43:17.946026 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":123,"threads_started":1}
Aug 08 18:43:17 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:17.948398 6616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:17.949112 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.948844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54916)
0808 18:43:17.948981 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.949039 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 18:43:17.949888 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.949610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54928)
0808 18:43:17.949766 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.949816 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260808 18:43:17.950064 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:17.951395 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.941310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48098)
0808 18:43:17.941457 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.941472 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:17.941549 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:17.942087 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:17.942090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:17.942265 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:17.942412 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.942420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.943948 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.943952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.944632 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:17.944644 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.945072 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.945076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:17.945222 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.945601 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:17.945617 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:17.947689 (+ 2072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:17.949850 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.949853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.949854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.950148 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.950466 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:17.950469 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:17.950471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:17.950563 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:17.950923 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:17.950926 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:17.951005 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 18:43:17.951087 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 18:43:17.951209 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":18}
I20260808 18:43:17.951484 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.941516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48098 (local address 127.4.61.253:45541)
0808 18:43:17.941857 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:17.941867 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:17.941879 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:17.941912 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:17.941914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:17.941955 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:17.942043 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:17.942773 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.943817 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.944737 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:17.944973 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:17.945064 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:17.947851 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:17.947854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:17.947857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:17.947882 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:17.949744 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.950239 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.950242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.950243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.950370 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:17.950639 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:17.950641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:17.950642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:17.950829 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:17.950910 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:17.951144 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 18:43:17.951262 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":276,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
I20260808 18:43:17.952033 6725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:17.952680 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.952396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54944)
0808 18:43:17.952519 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.952609 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 18:43:17.952905 6646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:17.953022 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:42379
--webserver_interface=127.4.61.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:43:17.955140 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.954917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54954)
0808 18:43:17.955029 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.955080 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:43:17.955278 6725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:17.981225 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 1
I20260808 18:43:17.982100 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.981798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54966)
0808 18:43:17.981949 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.982014 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 18:43:17.982894 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:17.982653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54976)
0808 18:43:17.982786 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:17.982837 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 18:43:17.983069 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:18.004559 6725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 1
I20260808 18:43:18.005563 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.005194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54986)
0808 18:43:18.005386 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.005466 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 18:43:18.006424 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.006127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:54990)
0808 18:43:18.006252 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.006346 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 18:43:18.006556 6725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:18.058255 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 2
I20260808 18:43:18.059099 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.058804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55004)
0808 18:43:18.058954 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.059017 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 18:43:18.059877 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.059663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55016)
0808 18:43:18.059769 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.059817 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 18:43:18.060019 6616 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
W20260808 18:43:18.067445 6738 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:18.067716 6738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:18.067755 6738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:18.067816 6738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:18.071808 6738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:18.071868 6738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:18.071890 6738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:18.071919 6738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:18.071941 6738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:18.074699 6725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 2
I20260808 18:43:18.075500 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.075179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55024)
0808 18:43:18.075336 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.075412 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 18:43:18.076146 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.075958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55028)
0808 18:43:18.076047 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.076092 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 18:43:18.076252 6725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:42379: Network error: Client connection negotiation failed: client connection to 127.4.61.252:42379: connect: Connection refused (error 111)
I20260808 18:43:18.077520 6738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:39071,127.4.61.253:45541,127.4.61.252:42379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:42379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.61.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:18.078603 6738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:18.079566 6738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:18.087814 6749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:18.087821 6746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:18.088022 6738 server_base.cc:1034] running on GCE node
W20260808 18:43:18.087831 6745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:18.088574 6738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:18.089674 6738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:18.090827 6738 hybrid_clock.cc:648] HybridClock initialized: now 1786214598090800 us; error 37 us; skew 500 ppm
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214598, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:18.093360 6738 init.cc:377] Logged in from keytab as kudu/127.4.61.252@KRBTEST.COM (short username kudu)
I20260808 18:43:18.094193 6738 webserver.cc:460] Webserver started at http://127.4.61.252:45279/ using document root <none> and password file <none>
I20260808 18:43:18.094743 6738 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:18.094810 6738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:18.095016 6738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:18.097004 6738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data/instance:
uuid: "b8bf39b07e50411d8d7f94b177c283e8"
format_stamp: "Formatted at 2026-08-08 18:43:18 on dist-test-slave-fgb3"
server_key: "541eef77c126048d125f8cac948f0309"
server_key_iv: "fa31fe1e5bbd05c5571b6f8698f97e3a"
server_key_version: "encryptionkey@0"
I20260808 18:43:18.097540 6738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal/instance:
uuid: "b8bf39b07e50411d8d7f94b177c283e8"
format_stamp: "Formatted at 2026-08-08 18:43:18 on dist-test-slave-fgb3"
server_key: "541eef77c126048d125f8cac948f0309"
server_key_iv: "fa31fe1e5bbd05c5571b6f8698f97e3a"
server_key_version: "encryptionkey@0"
I20260808 18:43:18.101130 6738 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 18:43:18.103374 6759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:18.104530 6738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:43:18.104640 6738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "b8bf39b07e50411d8d7f94b177c283e8"
format_stamp: "Formatted at 2026-08-08 18:43:18 on dist-test-slave-fgb3"
server_key: "541eef77c126048d125f8cac948f0309"
server_key_iv: "fa31fe1e5bbd05c5571b6f8698f97e3a"
server_key_version: "encryptionkey@0"
I20260808 18:43:18.104732 6738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:18.119002 6738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:18.121918 6738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:18.122088 6738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:18.128636 6738 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.252:42379
I20260808 18:43:18.128894 6832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.252:42379 every 8 connection(s)
I20260808 18:43:18.129560 6738 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
I20260808 18:43:18.132300 6833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:18.136049 6833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:18.139717 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 6738
I20260808 18:43:18.139823 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786214311986709-4343-0/minicluster-data/master-2/wal/instance
I20260808 18:43:18.140125 4343 external_mini_cluster.cc:1428] Setting key 7e34c55deb0c2ea73875a686bea52923
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214598, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:43:18.149629 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.137833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.4.61.254:39071)
0808 18:43:18.137983 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.137987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.138788 (+ 801us) server_negotiation.cc:407] Connection header received
0808 18:43:18.139697 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.139700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.139756 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.139834 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.141364 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.142018 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.143249 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.143481 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.143559 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.146125 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.146128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.146130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.146155 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.147593 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.148182 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.148186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.148188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.148266 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.148576 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.148579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.148581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.148768 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.148854 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.149335 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.149465 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 18:43:18.150420 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.140814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.4.61.252:42379)
0808 18:43:18.141181 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.141190 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.141210 (+ 20us) server_negotiation.cc:407] Connection header received
0808 18:43:18.141305 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.141310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.141500 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.141667 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.142414 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.143192 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.144214 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.144630 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.144707 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.147074 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.147079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.147089 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.147110 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.148477 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.148860 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.148872 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.148873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.148945 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.149189 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.149193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.149195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.149417 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.149622 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.150090 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.150206 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":147,"threads_started":1}
I20260808 18:43:18.150426 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.138188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:39071 (local address 127.0.0.1:56102)
0808 18:43:18.138649 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.138691 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:18.139496 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:18.140109 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:18.140117 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:18.140583 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:18.141214 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.141235 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.142159 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.142162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.143122 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.143132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.143625 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.143630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.143827 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.144439 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:18.144455 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:18.145989 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:18.147690 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.147699 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.147710 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.148088 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.148349 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.148352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.148354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.148489 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.148868 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:18.148875 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:18.149116 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 18:43:18.149276 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 18:43:18.149568 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":140,"threads_started":1}
I20260808 18:43:18.151592 6833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214598, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:18.159165 6616 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 3
I20260808 18:43:18.159799 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.152161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48106 (local address 127.4.61.253:45541)
0808 18:43:18.152295 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.152301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.152313 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:18.152351 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.152354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.152396 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.152468 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.152815 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.153580 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.154601 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.154965 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.155067 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.156779 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.156783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.156786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.156814 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.158237 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.158664 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.158667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.158669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.158746 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.158989 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.158993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.158995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.159179 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.159259 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.159524 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.159646 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 18:43:18.159883 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.152034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:45541 (local address 127.0.0.1:48106)
0808 18:43:18.152167 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.152176 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:18.152239 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:18.152486 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:18.152488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:18.152604 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:18.152694 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.152699 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.153682 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.153685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.154497 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.154508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.155060 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.155063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.155135 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.155525 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:18.155538 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:18.156650 (+ 1112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:18.158348 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.158352 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.158354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.158573 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.158828 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.158831 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.158833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.158903 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.159264 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:18.159267 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:18.159348 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 18:43:18.159452 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 18:43:18.159568 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 18:43:18.160641 6833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:18.161548 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.152823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56110 (local address 127.4.61.254:39071)
0808 18:43:18.152920 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.152924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.152936 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:18.153041 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.153042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.153073 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.153128 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.153767 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.154511 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.155407 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.155712 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.155815 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.158037 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.158040 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.158042 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.158062 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.159445 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.159907 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.159911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.159913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.159996 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.160279 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.160282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.160283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.160468 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.160668 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.161297 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.161409 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214598, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:43:18.167399 6725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } attempt: 3
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:18.168190 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.159534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55052)
0808 18:43:18.159766 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.159780 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:18.159850 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:18.160109 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:18.160112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:18.160258 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:18.160340 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.160347 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.161322 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.161325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.162037 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.162048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.162647 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.162651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.162726 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.163133 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:18.163146 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:18.164424 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:18.166599 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.166603 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.166605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.166833 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.167142 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.167146 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.167147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.167242 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.167693 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:18.167696 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:18.167798 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 18:43:18.167915 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 18:43:18.168043 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260808 18:43:18.168223 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.159733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55052 (local address 127.4.61.252:42379)
0808 18:43:18.159818 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.159822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.159834 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:18.159949 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.159952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.159996 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.160456 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.160537 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.161196 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.162174 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.162529 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.162916 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.164562 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.164565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.164568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.164594 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.166476 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.166923 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.166936 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.166938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.167014 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.167343 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.167346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.167348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.167561 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.167692 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.167988 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.168091 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 18:43:18.170548 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.161091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55064)
0808 18:43:18.161365 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.161376 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:18.161436 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:18.161648 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:18.161651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:18.162338 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:18.162419 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.162425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.163420 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.163424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.163972 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.163982 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.164991 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.164994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.165065 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.165429 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:18.165443 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:18.166656 (+ 1213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:18.169136 (+ 2480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.169140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.169142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.169364 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.169605 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.169608 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.169610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.169694 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.170128 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:18.170130 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:18.170197 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 18:43:18.170276 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 18:43:18.170411 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260808 18:43:18.171052 6840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.161141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55064 (local address 127.4.61.252:42379)
0808 18:43:18.161449 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.161458 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.161471 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:43:18.161502 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.161505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.161540 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.161629 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.162532 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.163314 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.164089 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.164891 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.164978 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.166792 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.166796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.166799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.166820 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.169034 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.169462 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.169464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.169466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.169527 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.169782 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.169785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.169787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.170015 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.170099 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.170709 (+ 610us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.170873 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":113,"threads_started":1}
I20260808 18:43:18.172433 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.162788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48110 (local address 127.4.61.253:45541)
0808 18:43:18.162883 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.162887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.162983 (+ 96us) server_negotiation.cc:407] Connection header received
0808 18:43:18.163132 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.163135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.163172 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.163213 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.163955 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.164488 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.165485 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.165693 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.165773 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.168400 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.168403 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.168405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.168430 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.170390 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.170843 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.170846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.170848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.170964 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.171241 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.171244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.171246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.171437 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.171625 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.172192 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.172301 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 18:43:18.172525 6616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: Bootstrap starting.
Aug 08 18:43:18 dist-test-slave-fgb3 krb5kdc[6478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214597, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:43:18.175305 6616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:18.175737 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:18.177389 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.167934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:42379 (local address 127.0.0.1:55078)
0808 18:43:18.168159 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:18.168171 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:18.168241 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:18.169342 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:18.169345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:18.169505 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:18.169594 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.169601 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.170576 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.170579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.171549 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:18.171559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.172198 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.172202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:18.172271 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.172664 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:18.172677 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:18.173843 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:18.175937 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.175940 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.175942 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.176155 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.176448 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:18.176452 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:18.176454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:18.176546 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:18.176936 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:18.176939 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:18.177031 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 18:43:18.177135 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 18:43:18.177255 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260808 18:43:18.177460 6841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.168158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55078 (local address 127.4.61.252:42379)
0808 18:43:18.168821 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.168831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.169155 (+ 324us) server_negotiation.cc:407] Connection header received
0808 18:43:18.169189 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.169192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.169233 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.169317 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.169704 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.170458 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.171801 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.172070 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.172452 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.173969 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.173972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.173975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.173998 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.175837 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.176249 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.176252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.176254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.176356 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.176639 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.176643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.176645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.176840 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.176939 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.177199 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.177305 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":112,"threads_started":1}
I20260808 18:43:18.177585 6833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: Bootstrap starting.
I20260808 18:43:18.177014 6566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2170b10a7d57498c8fde4b1208026fef"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56110
I20260808 18:43:18.179484 6616 log.cc:824] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:18.180071 6833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:18.180274 6725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: Bootstrap starting.
I20260808 18:43:18.180876 6833 log.cc:824] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:18.181571 6616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: No bootstrap required, opened a new log
I20260808 18:43:18.182636 6725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:18.182828 6833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: No bootstrap required, opened a new log
I20260808 18:43:18.183450 6725 log.cc:824] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:18.184573 6616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.184813 6616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2170b10a7d57498c8fde4b1208026fef, State: Initialized, Role: FOLLOWER
I20260808 18:43:18.185161 6616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.185588 6725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: No bootstrap required, opened a new log
I20260808 18:43:18.185739 6845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.185987 6845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.186545 6616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:18.186589 6566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 18:43:18.186676 6566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:18.187050 6833 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.187263 6833 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8bf39b07e50411d8d7f94b177c283e8, State: Initialized, Role: FOLLOWER
I20260808 18:43:18.187562 6833 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.187824 6566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.188773 6566 leader_election.cc:288] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [CANDIDATE]: Term 1 election: Requested vote from peers 2b98785300ca4de4b3e16b9b9bf148ca (127.4.61.253:45541), b8bf39b07e50411d8d7f94b177c283e8 (127.4.61.252:42379)
I20260808 18:43:18.188827 6833 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:18.189509 6725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.189728 6725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b98785300ca4de4b3e16b9b9bf148ca, State: Initialized, Role: FOLLOWER
I20260808 18:43:18.189960 6802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2170b10a7d57498c8fde4b1208026fef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b8bf39b07e50411d8d7f94b177c283e8"
I20260808 18:43:18.190033 6725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.190181 6802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:18.191298 6725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:18.191561 6802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2170b10a7d57498c8fde4b1208026fef in term 1.
I20260808 18:43:18.192468 6527 leader_election.cc:302] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2170b10a7d57498c8fde4b1208026fef, b8bf39b07e50411d8d7f94b177c283e8; no voters:
I20260808 18:43:18.192710 6845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:18.192782 6684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2170b10a7d57498c8fde4b1208026fef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2b98785300ca4de4b3e16b9b9bf148ca"
I20260808 18:43:18.192924 6845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [term 1 LEADER]: Becoming Leader. State: Replica: 2170b10a7d57498c8fde4b1208026fef, State: Running, Role: LEADER
I20260808 18:43:18.193013 6684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:18.193233 6845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } }
I20260808 18:43:18.194339 6684 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2170b10a7d57498c8fde4b1208026fef in term 1.
I20260808 18:43:18.195058 6845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2170b10a7d57498c8fde4b1208026fef. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.195176 6845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:18.195901 6854 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.196087 6854 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.194346 6501 master_runner.cc:186] Error getting master registration for 127.4.61.253:45541: OK, instance_id { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" instance_seqno: 1786214597912168 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 18:43:18.197554 6501 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 18:43:18.198616 6866 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:18.198688 6866 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:18.198943 6913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:18.199647 6913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:18.205575 6876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.205698 6876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.205802 6684 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [term 1 FOLLOWER]: Refusing update from remote peer 2170b10a7d57498c8fde4b1208026fef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:43:18.206630 6845 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:43:18.208767 6802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [term 1 FOLLOWER]: Refusing update from remote peer 2170b10a7d57498c8fde4b1208026fef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:43:18.209378 6904 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 18:43:18.210731 6914 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:18.210815 6914 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:18.211014 6876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2170b10a7d57498c8fde4b1208026fef. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.211187 6876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.213634 6854 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2170b10a7d57498c8fde4b1208026fef. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.213778 6854 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 18:43:18.213891 6920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:18.213969 6920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:18.216223 6904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.216354 6904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:18.217896 6876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.218052 6876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.218456 6921 mvcc.cc:205] Tried to move back new op lower bound from 7316334994244845568 to 7316334994202832896. Current Snapshot: MvccSnapshot[applied={T|T < 7316334994244845568}]
I20260808 18:43:18.218655 6924 mvcc.cc:205] Tried to move back new op lower bound from 7316334994244845568 to 7316334994202832896. Current Snapshot: MvccSnapshot[applied={T|T < 7316334994244845568}]
I20260808 18:43:18.220078 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.197745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48118 (local address 127.4.61.253:45541)
0808 18:43:18.197848 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.197852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.201725 (+ 3873us) server_negotiation.cc:407] Connection header received
0808 18:43:18.201951 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.201954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.202003 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.202055 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.205792 (+ 3737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.206493 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.207516 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.207832 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.207906 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.211707 (+ 3801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.211710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.211713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.211738 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.213297 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.217129 (+ 3832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.217132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.217134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.217231 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.218397 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.218401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.218402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.218667 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.218784 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.219805 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.219935 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:43:18.221602 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.195455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56126 (local address 127.4.61.254:39071)
0808 18:43:18.195615 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.195620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.201519 (+ 5899us) server_negotiation.cc:407] Connection header received
0808 18:43:18.202450 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.202453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.202502 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.202553 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.203990 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.204696 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.208052 (+ 3356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.208364 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.208451 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.213845 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.213849 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.213852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.213882 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.215637 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.217940 (+ 2303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.217944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.217946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.218054 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.219110 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.219114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.219115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.219334 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.219450 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.221324 (+ 1874us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.221462 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 18:43:18.224395 6845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.224519 6845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:18.225229 6841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:18.195480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.4.61.252:42379)
0808 18:43:18.195648 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.195652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.202566 (+ 6914us) server_negotiation.cc:407] Connection header received
0808 18:43:18.202662 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.202665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.202713 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.202790 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.205043 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.205799 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.209642 (+ 3843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:18.209987 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:18.210061 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:18.215409 (+ 5348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:18.215414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:18.215417 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:18.215447 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:18.217003 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.223831 (+ 6828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.223835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.223837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.223944 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:18.224262 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:18.224266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:18.224267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:18.224510 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:18.224627 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:18.224962 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 18:43:18.225089 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 18:43:18.225809 6854 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2170b10a7d57498c8fde4b1208026fef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2170b10a7d57498c8fde4b1208026fef" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 39071 } } peers { permanent_uuid: "2b98785300ca4de4b3e16b9b9bf148ca" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 45541 } } peers { permanent_uuid: "b8bf39b07e50411d8d7f94b177c283e8" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 42379 } } }
I20260808 18:43:18.225941 6854 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:18.226675 6928 mvcc.cc:205] Tried to move back new op lower bound from 7316334994244845568 to 7316334994202832896. Current Snapshot: MvccSnapshot[applied={T|T < 7316334994244845568}]
I20260808 18:43:18.230860 6913 catalog_manager.cc:1347] Generated new cluster ID: 918c29e9d437473fb7bc08d913af5d94
I20260808 18:43:18.230993 6913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:18.259995 6913 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:18.261554 6913 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:18.275463 6913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2170b10a7d57498c8fde4b1208026fef: Generated new TSK 0
I20260808 18:43:18.276654 6913 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:43:18.319554 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.316499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48128 (local address 127.4.61.253:45541)
0808 18:43:18.316632 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.316636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.318459 (+ 1823us) server_negotiation.cc:407] Connection header received
0808 18:43:18.318653 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.318656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.318707 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.318757 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.319413 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48128: BlockingRecv error: recv got EOF from 127.0.0.1:48128 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 18:43:18.321201 6620 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.317316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56142 (local address 127.4.61.254:39071)
0808 18:43:18.317443 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.317447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.320256 (+ 2809us) server_negotiation.cc:407] Connection header received
0808 18:43:18.320432 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.320436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.320487 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.320537 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.321071 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56142: BlockingRecv error: recv got EOF from 127.0.0.1:56142 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 18:43:18.322717 6841 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.317888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55104 (local address 127.4.61.252:42379)
0808 18:43:18.318020 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.318024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.321797 (+ 3773us) server_negotiation.cc:407] Connection header received
0808 18:43:18.321974 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.321978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.322027 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.322075 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.322601 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55104: BlockingRecv error: recv got EOF from 127.0.0.1:55104 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 18:43:18.327212 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.325686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48132 (local address 127.4.61.253:45541)
0808 18:43:18.325784 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.325788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.326280 (+ 492us) server_negotiation.cc:407] Connection header received
0808 18:43:18.326518 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.326521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.326599 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.326647 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.327123 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48132: BlockingRecv error: recv got EOF from 127.0.0.1:48132 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 18:43:18.332681 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.331308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48134 (local address 127.4.61.253:45541)
0808 18:43:18.331402 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.331406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.331856 (+ 450us) server_negotiation.cc:407] Connection header received
0808 18:43:18.332039 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.332042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.332090 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.332137 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.332591 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48134: BlockingRecv error: recv got EOF from 127.0.0.1:48134 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 18:43:18.338286 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.336824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48148 (local address 127.4.61.253:45541)
0808 18:43:18.336918 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.336923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.337419 (+ 496us) server_negotiation.cc:407] Connection header received
0808 18:43:18.337595 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.337598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.337644 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.337690 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.338191 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48148: BlockingRecv error: recv got EOF from 127.0.0.1:48148 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 18:43:18.346247 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.344637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48152 (local address 127.4.61.253:45541)
0808 18:43:18.344773 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.344777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.345286 (+ 509us) server_negotiation.cc:407] Connection header received
0808 18:43:18.345484 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.345487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.345543 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.345598 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.346139 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48152: BlockingRecv error: recv got EOF from 127.0.0.1:48152 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 18:43:18.358544 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.356773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48160 (local address 127.4.61.253:45541)
0808 18:43:18.356883 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.356887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.357496 (+ 609us) server_negotiation.cc:407] Connection header received
0808 18:43:18.357700 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.357703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.357756 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.357805 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.358429 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48160: BlockingRecv error: recv got EOF from 127.0.0.1:48160 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 18:43:18.379328 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.377415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48170 (local address 127.4.61.253:45541)
0808 18:43:18.377544 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.377548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.378190 (+ 642us) server_negotiation.cc:407] Connection header received
0808 18:43:18.378463 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.378467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.378527 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.378587 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.379202 (+ 615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48170: BlockingRecv error: recv got EOF from 127.0.0.1:48170 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 18:43:18.415171 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.413920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48184 (local address 127.4.61.253:45541)
0808 18:43:18.414057 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.414061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.414306 (+ 245us) server_negotiation.cc:407] Connection header received
0808 18:43:18.414476 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.414478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.414527 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.414594 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.415046 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48184: BlockingRecv error: recv got EOF from 127.0.0.1:48184 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 18:43:18.482577 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.481452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.4.61.253:45541)
0808 18:43:18.481643 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.481649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.481774 (+ 125us) server_negotiation.cc:407] Connection header received
0808 18:43:18.481901 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.481904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.481955 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.482029 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.482450 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48196: BlockingRecv error: recv got EOF from 127.0.0.1:48196 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 18:43:18.613981 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.612829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48210 (local address 127.4.61.253:45541)
0808 18:43:18.612990 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.612995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.613096 (+ 101us) server_negotiation.cc:407] Connection header received
0808 18:43:18.613258 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.613261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.613310 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.613401 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.613876 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48210: BlockingRecv error: recv got EOF from 127.0.0.1:48210 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 18:43:18.873281 6735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:18.872298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48216 (local address 127.4.61.253:45541)
0808 18:43:18.872450 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:18.872454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:18.872505 (+ 51us) server_negotiation.cc:407] Connection header received
0808 18:43:18.872645 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:18.872647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:18.872696 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:18.872767 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:18.873152 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48216: BlockingRecv error: recv got EOF from 127.0.0.1:48216 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:43:19.212205 6914 catalog_manager.cc:1259] Loaded cluster ID: 918c29e9d437473fb7bc08d913af5d94
I20260808 18:43:19.212294 6914 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: loading cluster ID for follower catalog manager: success
I20260808 18:43:19.213968 6914 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: acquiring CA information for follower catalog manager: success
I20260808 18:43:19.215346 6920 catalog_manager.cc:1259] Loaded cluster ID: 918c29e9d437473fb7bc08d913af5d94
I20260808 18:43:19.215418 6920 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: loading cluster ID for follower catalog manager: success
I20260808 18:43:19.215581 6914 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8bf39b07e50411d8d7f94b177c283e8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:43:19.216974 6920 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: acquiring CA information for follower catalog manager: success
I20260808 18:43:19.218001 6920 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2b98785300ca4de4b3e16b9b9bf148ca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:43:19.391605 7022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:19.387463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48222 (local address 127.4.61.253:45541)
0808 18:43:19.387705 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:19.387711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:19.387793 (+ 82us) server_negotiation.cc:407] Connection header received
0808 18:43:19.387963 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:19.387967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:19.388123 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:19.388227 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:19.388522 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.389091 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.390013 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.390235 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.390375 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:19.390717 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:19.391173 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:19.391287 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:19.391382 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 18:43:19.391440 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260808 18:43:19.398294 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:19.394905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.4.61.252:42379)
0808 18:43:19.395127 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:19.395130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:19.395143 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:43:19.395223 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:19.395225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:19.395347 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:19.395444 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:19.395605 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.396122 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.396899 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.397141 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.397222 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:19.397492 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:19.397946 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:19.398058 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:19.398082 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 18:43:19.398134 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260808 18:43:19.404971 7022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:19.401014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48234 (local address 127.4.61.253:45541)
0808 18:43:19.401337 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:19.401341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:19.401535 (+ 194us) server_negotiation.cc:407] Connection header received
0808 18:43:19.401644 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:19.401647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:19.401701 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:19.401764 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:19.402119 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.402805 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.403862 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.404192 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.404279 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:19.404509 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:19.404581 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:19.404643 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:19.404772 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 18:43:19.404830 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260808 18:43:19.405223 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:19.401527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55110 (local address 127.4.61.252:42379)
0808 18:43:19.401632 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:19.401636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:19.401648 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:19.401770 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:19.401773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:19.401813 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:19.401877 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:19.402170 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.402796 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.403846 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.404185 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.404282 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:19.404749 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:19.404827 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:19.404888 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:19.405042 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 18:43:19.405096 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:43:19.405881 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:19.401117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56144 (local address 127.4.61.254:39071)
0808 18:43:19.401764 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:19.401768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:19.401783 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:43:19.401878 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:19.401881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:19.402058 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:19.402173 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:19.402548 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.403289 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.404193 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:19.404508 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:19.404603 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:19.404933 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:19.405450 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:19.405532 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:19.405670 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 18:43:19.405728 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":61,"threads_started":1}
I20260808 18:43:19.408620 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6501
I20260808 18:43:19.422731 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6624
I20260808 18:43:19.436154 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 6738
2026-08-08T18:43:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3216 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 18:43:19 dist-test-slave-fgb3 krb5kdc[7057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 18:43:19 dist-test-slave-fgb3 krb5kdc[7057](info): set up 2 sockets
Aug 08 18:43:19 dist-test-slave-fgb3 krb5kdc[7057](info): commencing operation
krb5kdc: starting...
W20260808 18:43:20.574484 4343 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/test-user.keytab.
Aug 08 18:43:20 dist-test-slave-fgb3 krb5kdc[7057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T18:43:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T18:43:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.61.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
Entry for principal kudu/127.4.61.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab.
I20260808 18:43:20.695382 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44217
--webserver_interface=127.4.61.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 18:43:20.806063 7079 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:20.806428 7079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:20.806478 7079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:20.806542 7079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:20.810554 7079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:20.810622 7079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:20.810648 7079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:20.810668 7079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:20.810689 7079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:20.816005 7079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.254.keytab
--principal=kudu/127.4.61.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.254:44217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.61.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:20.817227 7079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:20.818348 7079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:20.826848 7092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:20.826844 7088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:20.826841 7089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:20.826896 7079 server_base.cc:1034] running on GCE node
I20260808 18:43:20.827654 7079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:20.828744 7079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:20.829919 7079 hybrid_clock.cc:648] HybridClock initialized: now 1786214600829893 us; error 39 us; skew 500 ppm
Aug 08 18:43:20 dist-test-slave-fgb3 krb5kdc[7057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:20.832773 7079 init.cc:377] Logged in from keytab as kudu/127.4.61.254@KRBTEST.COM (short username kudu)
I20260808 18:43:20.833721 7079 webserver.cc:460] Webserver started at http://127.4.61.254:37863/ using document root <none> and password file <none>
I20260808 18:43:20.834270 7079 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:20.834393 7079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:20.834612 7079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:20.836699 7079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data/instance:
uuid: "98a61ff208584c119548ef58e5a7e735"
format_stamp: "Formatted at 2026-08-08 18:43:20 on dist-test-slave-fgb3"
server_key: "aec9800812c18c6c993449019899a2c7"
server_key_iv: "7ee483e8548898ef7260d866e001665b"
server_key_version: "encryptionkey@0"
I20260808 18:43:20.837262 7079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance:
uuid: "98a61ff208584c119548ef58e5a7e735"
format_stamp: "Formatted at 2026-08-08 18:43:20 on dist-test-slave-fgb3"
server_key: "aec9800812c18c6c993449019899a2c7"
server_key_iv: "7ee483e8548898ef7260d866e001665b"
server_key_version: "encryptionkey@0"
I20260808 18:43:20.841153 7079 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 18:43:20.843710 7103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:20.844991 7079 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:43:20.845124 7079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal
uuid: "98a61ff208584c119548ef58e5a7e735"
format_stamp: "Formatted at 2026-08-08 18:43:20 on dist-test-slave-fgb3"
server_key: "aec9800812c18c6c993449019899a2c7"
server_key_iv: "7ee483e8548898ef7260d866e001665b"
server_key_version: "encryptionkey@0"
I20260808 18:43:20.845229 7079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:20.863823 7079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:20.866859 7079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:20.867049 7079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:20.873800 7079 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.254:44217
I20260808 18:43:20.874073 7180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.254:44217 every 8 connection(s)
I20260808 18:43:20.874819 7079 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/data/info.pb
I20260808 18:43:20.877707 7181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:20.881315 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7079
I20260808 18:43:20.881448 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-0/wal/instance
I20260808 18:43:20.881771 4343 external_mini_cluster.cc:1428] Setting key 84e3aa2238eba646b31e632bb2b388ed
I20260808 18:43:20.881701 7181 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.61.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.253@KRBTEST.COM" created.
Aug 08 18:43:20 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:20.898134 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.884334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37848 (local address 127.4.61.254:44217)
0808 18:43:20.884749 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:20.884772 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:20.885027 (+ 255us) server_negotiation.cc:407] Connection header received
0808 18:43:20.886001 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:20.886006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:20.886192 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:20.886379 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:20.887213 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:20.888072 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:20.889016 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:20.889387 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:20.889551 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:20.893661 (+ 4110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:20.893668 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:20.893681 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:20.893708 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:20.895247 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:20.895767 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:20.895771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:20.895772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:20.895870 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:20.896177 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:20.896179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:20.896180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:20.896546 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:20.896644 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:20.897087 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 18:43:20.897312 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":276,"thread_start_us":124,"threads_started":1}
I20260808 18:43:20.898140 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.884335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44217 (local address 127.0.0.1:37848)
0808 18:43:20.884884 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:20.884920 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:20.885715 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:20.886390 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:20.886395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:20.886830 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:20.887073 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:20.887087 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:20.888186 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:20.888189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:20.888898 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:20.888907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:20.889532 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:20.889536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:20.889690 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:20.890282 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:20.890298 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:20.893506 (+ 3208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:20.895357 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:20.895367 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:20.895377 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:20.895674 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:20.895954 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:20.895957 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:20.895959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:20.896102 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:20.896661 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:20.896668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:20.896837 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 18:43:20.897029 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 18:43:20.897402 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":70,"spinlock_wait_cycles":26880,"thread_start_us":146,"threads_started":1}
I20260808 18:43:20.900589 7181 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:20.901276 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.901013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55344)
0808 18:43:20.901143 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:20.901217 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 18:43:20.901446 7105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
I20260808 18:43:20.902244 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.902035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55356)
0808 18:43:20.902139 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:20.902185 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 18:43:20.902387 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40149: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
Entry for principal kudu/127.4.61.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab.
I20260808 18:43:20.907246 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:40149
--webserver_interface=127.4.61.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:43:20.951599 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } attempt: 1
I20260808 18:43:20.952477 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.952122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55364)
0808 18:43:20.952291 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:20.952369 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 18:43:20.953214 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:20.952983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55374)
0808 18:43:20.953091 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:20.953146 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 18:43:20.953342 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40149: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
W20260808 18:43:21.018273 7193 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:21.018635 7193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:21.018662 7193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:21.018724 7193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 18:43:21.021510 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } attempt: 2
I20260808 18:43:21.022399 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.022043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55384)
0808 18:43:21.022211 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.022282 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 18:43:21.022955 7193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:21.023058 7193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:21.023101 7193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260808 18:43:21.023138 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.022922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55396)
0808 18:43:21.023023 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.023077 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 18:43:21.023164 7193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:21.023190 7193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 18:43:21.023283 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.253:40149: Network error: Client connection negotiation failed: client connection to 127.4.61.253:40149: connect: Connection refused (error 111)
I20260808 18:43:21.028625 7193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.253.keytab
--principal=kudu/127.4.61.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.253:40149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.61.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:21.029695 7193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:21.030747 7193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 18:43:21.039352 7193 server_base.cc:1034] running on GCE node
W20260808 18:43:21.039312 7200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:21.039312 7204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:21.039336 7202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:21.040150 7193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:21.041249 7193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:21.042374 7193 hybrid_clock.cc:648] HybridClock initialized: now 1786214601042355 us; error 34 us; skew 500 ppm
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:21.045064 7193 init.cc:377] Logged in from keytab as kudu/127.4.61.253@KRBTEST.COM (short username kudu)
I20260808 18:43:21.045946 7193 webserver.cc:460] Webserver started at http://127.4.61.253:35153/ using document root <none> and password file <none>
I20260808 18:43:21.046547 7193 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:21.046618 7193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:21.046826 7193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:21.048836 7193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data/instance:
uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "5df26db04c06573729c122b4e9d50ced"
server_key_iv: "56cebe761ae1dee42459e673fac7c82c"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.049419 7193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal/instance:
uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "5df26db04c06573729c122b4e9d50ced"
server_key_iv: "56cebe761ae1dee42459e673fac7c82c"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.053077 7193 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 18:43:21.055387 7213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:21.056531 7193 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 18:43:21.056644 7193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal
uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "5df26db04c06573729c122b4e9d50ced"
server_key_iv: "56cebe761ae1dee42459e673fac7c82c"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.056733 7193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:21.073367 7193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:21.076193 7193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:21.076411 7193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:21.083093 7193 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.253:40149
I20260808 18:43:21.083364 7298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.253:40149 every 8 connection(s)
I20260808 18:43:21.084165 7193 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/data/info.pb
I20260808 18:43:21.087095 7302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:21.090969 7302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:21.093575 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7193
I20260808 18:43:21.093703 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-1/wal/instance
I20260808 18:43:21.094022 4343 external_mini_cluster.cc:1428] Setting key 77d8479a662c7d1d03eb089ec3ff26c7
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.61.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.61.252@KRBTEST.COM" created.
I20260808 18:43:21.105073 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.092800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.4.61.254:44217)
0808 18:43:21.092957 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.092962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.093884 (+ 922us) server_negotiation.cc:407] Connection header received
0808 18:43:21.095063 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.095066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.095121 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.095194 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.096592 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.097126 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.098277 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.098560 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.098657 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.101012 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.101015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.101017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.101044 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.103000 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.103467 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.103470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.103472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.103549 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.103858 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.103861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.103863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.104070 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.104164 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.104766 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.104895 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 18:43:21.105862 7305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.093187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44217 (local address 127.0.0.1:37858)
0808 18:43:21.093712 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.093772 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.094837 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.095392 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.095400 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.095864 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.096441 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.096456 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.097252 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.097255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.098154 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.098164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.098711 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.098716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.098875 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.099442 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.099461 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.100847 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.103108 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.103114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.103131 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.103372 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.103631 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.103634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.103636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.103771 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.104174 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.104214 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.104480 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.104691 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.105016 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":120,"threads_started":1}
I20260808 18:43:21.107240 7302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:21.114457 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } attempt: 3
I20260808 18:43:21.116340 7305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.107722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55406)
0808 18:43:21.107821 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.107834 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.107904 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.108461 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.108464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.108634 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.108707 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.108712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.109659 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.109662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.110185 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.110193 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.110822 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.110825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.110944 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.111361 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.111375 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.112738 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.114588 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.114591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.114593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.114797 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.115194 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.115197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.115198 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.115292 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.115812 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.115814 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.115924 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.116051 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.116170 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260808 18:43:21.116468 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.107844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.4.61.253:40149)
0808 18:43:21.108146 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.108154 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.108170 (+ 16us) server_negotiation.cc:407] Connection header received
0808 18:43:21.108200 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.108203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.108346 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.108466 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.108804 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.109554 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.110284 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.110717 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.110813 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.112871 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.112880 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.112892 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.112916 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.114492 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.114910 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.114916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.114918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.115078 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.115388 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.115391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.115392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.115710 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.115853 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.116148 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.116272 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":225,"thread_start_us":146,"threads_started":1}
I20260808 18:43:21.118577 7302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
Entry for principal kudu/127.4.61.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab.
I20260808 18:43:21.119350 7305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.119042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42542)
0808 18:43:21.119206 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.119278 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260808 18:43:21.119530 7215 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:21.119849 4343 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
/tmp/dist-test-tasklYnvF7/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:36915
--webserver_interface=127.4.61.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.61.212:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 18:43:21.120339 7305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.120142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42554)
0808 18:43:21.120220 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.120266 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25,"thread_start_us":78,"threads_started":1}
W20260808 18:43:21.120555 7302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.123308 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.114991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55412 (local address 127.4.61.253:40149)
0808 18:43:21.115290 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.115299 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.115312 (+ 13us) server_negotiation.cc:407] Connection header received
0808 18:43:21.115341 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.115344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.115386 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.115460 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.115948 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.116840 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.117660 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.117899 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.117996 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.120177 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.120181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.120183 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.120206 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.121757 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.122222 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.122224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.122225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.122293 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.122577 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.122579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.122580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.122748 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.122831 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.123100 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.123188 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":94,"threads_started":1}
I20260808 18:43:21.123359 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.114899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55412)
0808 18:43:21.115112 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.115126 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.115201 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.115509 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.115512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.115681 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.115810 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.115818 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.116966 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.116969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.117552 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.117561 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.118010 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.118013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.118116 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.118594 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.118606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.120012 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.121879 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.121882 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.121885 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.122133 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.122397 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.122400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.122402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.122502 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.122837 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.122841 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.122956 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.123063 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.123209 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260808 18:43:21.124047 7181 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } has no permanent_uuid. Determining permanent_uuid...
I20260808 18:43:21.124694 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.124472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42568)
0808 18:43:21.124585 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.124635 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 18:43:21.125351 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.125084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42576)
0808 18:43:21.125263 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.125302 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260808 18:43:21.125494 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.156639 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 1
I20260808 18:43:21.157512 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.157193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42592)
0808 18:43:21.157349 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.157427 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 18:43:21.158248 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.158031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42598)
0808 18:43:21.158140 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.158187 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 18:43:21.158387 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.169827 7302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 1
I20260808 18:43:21.170745 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.170382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42600)
0808 18:43:21.170543 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.170621 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 18:43:21.171468 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.171238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42602)
0808 18:43:21.171332 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.171386 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 18:43:21.171604 7302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.233560 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 2
I20260808 18:43:21.234465 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.234103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42606)
0808 18:43:21.234275 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.234369 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 18:43:21.235275 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.235048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42620)
0808 18:43:21.235152 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.235209 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 18:43:21.235034 7317 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 18:43:21.235442 7317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 18:43:21.235495 7317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 18:43:21.235555 7317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 18:43:21.235831 7181 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.239739 7302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 2
W20260808 18:43:21.239831 7317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 18:43:21.239881 7317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 18:43:21.239904 7317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 18:43:21.239935 7317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 18:43:21.239964 7317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 18:43:21.240484 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.240181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42624)
0808 18:43:21.240328 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.240403 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 18:43:21.241166 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.240982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42628)
0808 18:43:21.241071 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.241113 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 18:43:21.241281 7302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.61.252:36915: Network error: Client connection negotiation failed: client connection to 127.4.61.252:36915: connect: Connection refused (error 111)
I20260808 18:43:21.245597 7317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.61.212:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.61.254:44217,127.4.61.253:40149,127.4.61.252:36915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/krb5kdc/kudu_127.4.61.252.keytab
--principal=kudu/127.4.61.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.61.252:36915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.61.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 17:55:42 UTC on ccycloud.quasar-domehl.root.comops.site
build id 4575373
I20260808 18:43:21.246709 7317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 18:43:21.247720 7317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 18:43:21.256047 7327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:21.256053 7322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 18:43:21.256062 7325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 18:43:21.256310 7317 server_base.cc:1034] running on GCE node
I20260808 18:43:21.256913 7317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 18:43:21.258004 7317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 18:43:21.259163 7317 hybrid_clock.cc:648] HybridClock initialized: now 1786214601259143 us; error 30 us; skew 500 ppm
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 18:43:21.261940 7317 init.cc:377] Logged in from keytab as kudu/127.4.61.252@KRBTEST.COM (short username kudu)
I20260808 18:43:21.262904 7317 webserver.cc:460] Webserver started at http://127.4.61.252:36163/ using document root <none> and password file <none>
I20260808 18:43:21.263461 7317 fs_manager.cc:359] Metadata directory not provided
I20260808 18:43:21.263530 7317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 18:43:21.263741 7317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 18:43:21.265842 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data/instance:
uuid: "58650e4f91bc4594b6e774b6a390c6b4"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "67712051938eb16a0d2461f30c6ae5aa"
server_key_iv: "61614975b110b2bd89ac5a3d4249751a"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.266455 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal/instance:
uuid: "58650e4f91bc4594b6e774b6a390c6b4"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "67712051938eb16a0d2461f30c6ae5aa"
server_key_iv: "61614975b110b2bd89ac5a3d4249751a"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.270103 7317 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 18:43:21.272541 7336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 18:43:21.273768 7317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 18:43:21.273896 7317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal
uuid: "58650e4f91bc4594b6e774b6a390c6b4"
format_stamp: "Formatted at 2026-08-08 18:43:21 on dist-test-slave-fgb3"
server_key: "67712051938eb16a0d2461f30c6ae5aa"
server_key_iv: "61614975b110b2bd89ac5a3d4249751a"
server_key_version: "encryptionkey@0"
I20260808 18:43:21.273995 7317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 18:43:21.294934 7317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 18:43:21.297904 7317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 18:43:21.298106 7317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 18:43:21.304867 7317 rpc_server.cc:307] RPC server started. Bound to: 127.4.61.252:36915
I20260808 18:43:21.305192 7424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.61.252:36915 every 8 connection(s)
I20260808 18:43:21.305831 7317 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/data/info.pb
I20260808 18:43:21.308089 4343 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu as pid 7317
I20260808 18:43:21.308203 4343 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYnvF7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786214311986709-4343-0/minicluster-data/master-2/wal/instance
I20260808 18:43:21.308490 4343 external_mini_cluster.cc:1428] Setting key 4d5b0a7bb9a49b40270e4bd92640cf80
I20260808 18:43:21.308852 7425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 18:43:21.314152 7425 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:21.324982 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.309864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42636 (local address 127.4.61.252:36915)
0808 18:43:21.310305 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.310352 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.310398 (+ 46us) server_negotiation.cc:407] Connection header received
0808 18:43:21.311279 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.311308 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.311763 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.312151 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.313261 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.314789 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.315959 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.316688 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.316867 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.320130 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.320135 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.320144 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.320173 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.321887 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.322295 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.322301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.322307 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.322451 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.322709 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.322713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.322714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.323218 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.323380 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.323662 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.323951 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":116,"threads_started":1}
I20260808 18:43:21.326526 7431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.316339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.254:44217 (local address 127.0.0.1:37866)
0808 18:43:21.317414 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.317470 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.317649 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.318108 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.318113 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.318529 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.318714 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.318722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.319761 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.319764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.320703 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.320716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.321268 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.321270 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.321356 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.321793 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.321805 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.323127 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.324876 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.324884 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.324888 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.325099 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.325392 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.325395 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.325397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.325487 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.325866 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.325872 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.325977 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.326134 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.326331 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":155,"threads_started":1}
I20260808 18:43:21.326622 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.316835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37866 (local address 127.4.61.254:44217)
0808 18:43:21.317127 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.317134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.317551 (+ 417us) server_negotiation.cc:407] Connection header received
0808 18:43:21.317767 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.317771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.317829 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.317884 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.318864 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.319602 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.320846 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.321152 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.321272 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.323265 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.323267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.323270 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.323293 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.324757 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.325219 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.325223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.325225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.325306 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.325570 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.325574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.325575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.325764 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.325851 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.326225 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.326427 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 18:43:21.327735 7425 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.254@KRBTEST.COM
I20260808 18:43:21.332548 7302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 3
I20260808 18:43:21.334972 7181 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } attempt: 3
I20260808 18:43:21.336923 7431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.328191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.253:40149 (local address 127.0.0.1:55424)
0808 18:43:21.328290 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.328303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.328367 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.328604 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.328607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.328758 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.328871 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.328878 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.329593 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.329597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.330095 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.330103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.330599 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.330602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.330692 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.331040 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.331049 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.332154 (+ 1105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.334062 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.334065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.334067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.334333 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.334586 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.334588 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.334590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.334683 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.336003 (+ 1320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.336006 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.336099 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.336629 (+ 530us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.336751 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 18:43:21.337421 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.327905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37882 (local address 127.4.61.254:44217)
0808 18:43:21.328011 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.328015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.328302 (+ 287us) server_negotiation.cc:407] Connection header received
0808 18:43:21.328341 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.328344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.328382 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.328457 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.329178 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.329640 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.330366 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.330580 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.330662 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.332809 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.332812 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.332815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.332840 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.335220 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.335666 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.335670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.335672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.335755 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.336074 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.336077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.336079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.336290 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.336509 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.337163 (+ 654us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.337270 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.253@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:43:21.338282 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.328296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.4.61.253:40149)
0808 18:43:21.328409 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.328413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.328423 (+ 10us) server_negotiation.cc:407] Connection header received
0808 18:43:21.328469 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.328471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.328508 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.328568 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.328982 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.329493 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.330203 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.330500 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.330590 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.332282 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.332285 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.332287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.332311 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.333969 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.334421 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.334425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.334427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.334509 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.334783 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.334786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.334788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.335871 (+ 1083us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.335966 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.336548 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.338131 (+ 1583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 18:43:21.339326 7425 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.254@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
I20260808 18:43:21.341393 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.332927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42650)
0808 18:43:21.333130 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.333144 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.333236 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.333470 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.333474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.333663 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.333806 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.333814 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.334699 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.334703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.335318 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.335329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.335918 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.335922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.336030 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.336464 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.336480 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.337960 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.339822 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.339825 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.339827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.340101 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.340409 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.340412 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.340414 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.340503 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.340927 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.340930 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.341019 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.341094 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.341230 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260808 18:43:21.342172 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.333005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42650 (local address 127.4.61.252:36915)
0808 18:43:21.333104 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.333107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.333202 (+ 95us) server_negotiation.cc:407] Connection header received
0808 18:43:21.333310 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.333314 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.333355 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.333452 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.333903 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.334574 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.335477 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.335799 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.336243 (+ 444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.338100 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.338104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.338106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.338132 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.339703 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.340225 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.340228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.340230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.340307 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.340613 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.340616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.340618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.340810 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.341838 (+ 1028us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.341922 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.342033 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214601, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.61.252@KRBTEST.COM for kudu/127.4.61.252@KRBTEST.COM
Aug 08 18:43:21 dist-test-slave-fgb3 krb5kdc[7057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786214600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.61.253@KRBTEST.COM
I20260808 18:43:21.345194 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.335357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42666)
0808 18:43:21.335466 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.335478 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.335546 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.336154 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.336158 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.336329 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.336432 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.336440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.337869 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.337873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.338659 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.338669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.339269 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.339273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.339350 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.339720 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.339734 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.341392 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.343727 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.343730 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.343732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.343969 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.344255 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.344258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.344260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.344339 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.344751 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.344755 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.344848 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.344942 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.345058 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 18:43:21.345994 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.335604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42666 (local address 127.4.61.252:36915)
0808 18:43:21.335929 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.335939 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.335951 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:21.335983 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.335986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.336026 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.336543 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.336627 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.337757 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.338784 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.339147 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.339538 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.341533 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.341536 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.341539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.341562 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.343606 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.344085 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.344088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.344089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.344166 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.344440 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.344443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.344444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.344638 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.345627 (+ 989us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.345704 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.345814 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":99,"threads_started":1}
I20260808 18:43:21.346094 7302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: Bootstrap starting.
I20260808 18:43:21.348963 7181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: Bootstrap starting.
I20260808 18:43:21.349182 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.339211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55430 (local address 127.4.61.253:40149)
0808 18:43:21.339310 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.339315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.339327 (+ 12us) server_negotiation.cc:407] Connection header received
0808 18:43:21.339358 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.339361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.339399 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.339483 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.340229 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.340925 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.342178 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.342722 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.342822 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.345621 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.345624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.345627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.345649 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.347502 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.347969 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.347973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.347975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.348059 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.348343 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.348347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.348348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.348554 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.348742 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.348943 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.349052 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 18:43:21.349267 7302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:21.350075 7302 log.cc:824] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:21.351469 7181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:21.352316 7181 log.cc:824] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:21.352922 7431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.339975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.61.252:36915 (local address 127.0.0.1:42678)
0808 18:43:21.340288 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 18:43:21.340299 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 18:43:21.340357 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 18:43:21.340759 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 18:43:21.340762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 18:43:21.340912 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 18:43:21.340993 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.341000 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.341996 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.342000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.342679 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 18:43:21.342689 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.343194 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.343198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 18:43:21.343276 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.343662 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 18:43:21.343675 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 18:43:21.345428 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 18:43:21.351545 (+ 6117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.351547 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.351549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.351768 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.352049 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 18:43:21.352051 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 18:43:21.352053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 18:43:21.352131 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 18:43:21.352506 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 18:43:21.352509 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 18:43:21.352579 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 18:43:21.352648 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 18:43:21.352771 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245}
I20260808 18:43:21.353433 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.340294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42678 (local address 127.4.61.252:36915)
0808 18:43:21.340575 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.340584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.340595 (+ 11us) server_negotiation.cc:407] Connection header received
0808 18:43:21.340620 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.340622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.340657 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.341085 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.341191 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.341900 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.342776 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.343086 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.343470 (+ 384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.345561 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.345564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.345567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.345590 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.351428 (+ 5838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.351880 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.351883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.351884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.351964 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.352214 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.352217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.352218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.352413 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.353089 (+ 676us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.353163 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.353276 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":133,"threads_started":1}
I20260808 18:43:21.353838 4343 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 18:43:21.354941 7181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: No bootstrap required, opened a new log
I20260808 18:43:21.356097 7425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: Bootstrap starting.
I20260808 18:43:21.355175 7140 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "98a61ff208584c119548ef58e5a7e735"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37882
I20260808 18:43:21.357868 7181 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.358071 7181 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a61ff208584c119548ef58e5a7e735, State: Initialized, Role: FOLLOWER
I20260808 18:43:21.358443 7181 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.358664 7425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: Neither blocks nor log segments found. Creating new log.
I20260808 18:43:21.358919 7439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.359052 7439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.359485 7425 log.cc:824] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: Log is configured to *not* fsync() on all Append() calls
I20260808 18:43:21.359689 7181 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:21.359836 7140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 18:43:21.359959 7302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: No bootstrap required, opened a new log
I20260808 18:43:21.359953 7140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:21.361169 7140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.361579 7425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: No bootstrap required, opened a new log
I20260808 18:43:21.362095 7140 leader_election.cc:288] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [CANDIDATE]: Term 1 election: Requested vote from peers eb0dfa3a4d5f43cc895dfe19f3d97ef2 (127.4.61.253:40149), 58650e4f91bc4594b6e774b6a390c6b4 (127.4.61.252:36915)
W20260808 18:43:21.364723 7453 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:21.364807 7453 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:21.366416 7425 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.366665 7425 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58650e4f91bc4594b6e774b6a390c6b4, State: Initialized, Role: FOLLOWER
I20260808 18:43:21.366989 7425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.367564 7464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.367843 7464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.368328 7425 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:21.368381 7384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98a61ff208584c119548ef58e5a7e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "58650e4f91bc4594b6e774b6a390c6b4"
W20260808 18:43:21.368593 7109 tablet.cc:2369] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 18:43:21.368584 7384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:21.369938 7384 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a61ff208584c119548ef58e5a7e735 in term 1.
I20260808 18:43:21.370501 7105 leader_election.cc:302] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58650e4f91bc4594b6e774b6a390c6b4, 98a61ff208584c119548ef58e5a7e735; no voters:
I20260808 18:43:21.370743 7439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 18:43:21.370954 7439 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [term 1 LEADER]: Becoming Leader. State: Replica: 98a61ff208584c119548ef58e5a7e735, State: Running, Role: LEADER
I20260808 18:43:21.371273 7439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.364987 7079 master_runner.cc:186] Error getting master registration for 127.4.61.253:40149: OK, instance_id { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" instance_seqno: 1786214601081213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 18:43:21.373306 7079 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 18:43:21.373806 7302 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.374061 7302 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0dfa3a4d5f43cc895dfe19f3d97ef2, State: Initialized, Role: FOLLOWER
I20260808 18:43:21.374191 7465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98a61ff208584c119548ef58e5a7e735. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.374430 7465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:21.374432 7302 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } }
I20260808 18:43:21.375043 7472 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.375319 7472 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.375404 7467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 18:43:21.375772 7302 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 18:43:21.375804 7259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98a61ff208584c119548ef58e5a7e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2"
I20260808 18:43:21.376017 7259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 18:43:21.376433 7467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 18:43:21.377346 7259 raft_consensus.cc:2454] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a61ff208584c119548ef58e5a7e735 in term 1.
I20260808 18:43:21.382401 7317 master_runner.cc:186] Error getting master registration for 127.4.61.253:40149: OK, instance_id { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" instance_seqno: 1786214601081213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 18:43:21.385535 7317 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 18:43:21.388707 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.377897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55446 (local address 127.4.61.253:40149)
0808 18:43:21.378271 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.378276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.378868 (+ 592us) server_negotiation.cc:407] Connection header received
0808 18:43:21.379131 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.379135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.379186 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.379235 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.381005 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.381736 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.382850 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.383169 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.383239 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.385019 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.385023 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.385026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.385051 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.386867 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.387348 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.387352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.387354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.387443 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.387753 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.387769 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.387770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.387984 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.388084 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.388446 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.388563 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302}
I20260808 18:43:21.392181 7384 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [term 1 FOLLOWER]: Refusing update from remote peer 98a61ff208584c119548ef58e5a7e735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 18:43:21.392547 7504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 18:43:21.392616 7504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:21.392874 7465 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:43:21.394119 7259 raft_consensus.cc:1261] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [term 1 FOLLOWER]: Refusing update from remote peer 98a61ff208584c119548ef58e5a7e735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 18:43:21.394695 7465 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 18:43:21.396970 7464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98a61ff208584c119548ef58e5a7e735. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.397102 7464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.398483 7472 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98a61ff208584c119548ef58e5a7e735. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.398600 7472 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.400995 7465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.401108 7465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:21.401288 7464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.401397 7464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.401381 7519 mvcc.cc:205] Tried to move back new op lower bound from 7316335007290667008 to 7316335007219523584. Current Snapshot: MvccSnapshot[applied={T|T < 7316335007290667008}]
I20260808 18:43:21.402968 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.378071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42694 (local address 127.4.61.252:36915)
0808 18:43:21.378220 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.378224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.380491 (+ 2267us) server_negotiation.cc:407] Connection header received
0808 18:43:21.380648 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.380651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.380701 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.380751 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.383492 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.384230 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.387276 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.389835 (+ 2559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.389936 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.398726 (+ 8790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.398730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.398732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.398760 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.400387 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.401514 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.401517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.401519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.401608 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.401930 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.401934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.401935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.402180 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.402345 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.402697 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.402825 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 18:43:21.404515 7465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.404639 7465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735 [sys.catalog]: This master's current role is: LEADER
I20260808 18:43:21.405752 7472 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98a61ff208584c119548ef58e5a7e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98a61ff208584c119548ef58e5a7e735" member_type: VOTER last_known_addr { host: "127.4.61.254" port: 44217 } } peers { permanent_uuid: "eb0dfa3a4d5f43cc895dfe19f3d97ef2" member_type: VOTER last_known_addr { host: "127.4.61.253" port: 40149 } } peers { permanent_uuid: "58650e4f91bc4594b6e774b6a390c6b4" member_type: VOTER last_known_addr { host: "127.4.61.252" port: 36915 } } }
I20260808 18:43:21.405862 7472 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 18:43:21.406414 7523 mvcc.cc:205] Tried to move back new op lower bound from 7316335007290667008 to 7316335007219523584. Current Snapshot: MvccSnapshot[applied={T|T < 7316335007290667008}]
I20260808 18:43:21.407265 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:21.375044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37898 (local address 127.4.61.254:44217)
0808 18:43:21.375160 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.375165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.378591 (+ 3426us) server_negotiation.cc:407] Connection header received
0808 18:43:21.380247 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.380250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.380302 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.380355 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.381828 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.382597 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.385533 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:21.385847 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:21.385928 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:21.403636 (+ 17708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 18:43:21.403641 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 18:43:21.403643 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 18:43:21.403672 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 18:43:21.405336 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.405844 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.405847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.405849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.405937 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 18:43:21.406244 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 18:43:21.406247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 18:43:21.406249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 18:43:21.406499 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 18:43:21.406614 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:21.406980 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 18:43:21.407107 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 18:43:21.410427 7505 mvcc.cc:205] Tried to move back new op lower bound from 7316335007290667008 to 7316335007219523584. Current Snapshot: MvccSnapshot[applied={T|T < 7316335007290667008}]
I20260808 18:43:21.411087 7517 catalog_manager.cc:1259] Loaded cluster ID: 5a81bd7b36fa427d95c10df4485c45a9
I20260808 18:43:21.411149 7517 catalog_manager.cc:1552] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: loading cluster ID for follower catalog manager: success
W20260808 18:43:21.411698 7517 catalog_manager.cc:1576] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 18:43:21.411789 7517 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 18:43:21.415831 7467 catalog_manager.cc:1347] Generated new cluster ID: 5a81bd7b36fa427d95c10df4485c45a9
I20260808 18:43:21.415902 7467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 18:43:21.442404 7467 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 18:43:21.443717 7467 catalog_manager.cc:1504] Loading token signing keys...
I20260808 18:43:21.459746 7467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98a61ff208584c119548ef58e5a7e735: Generated new TSK 0
I20260808 18:43:21.461027 7467 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 18:43:21.492013 7185 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.488843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37906 (local address 127.4.61.254:44217)
0808 18:43:21.488974 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.488979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.490889 (+ 1910us) server_negotiation.cc:407] Connection header received
0808 18:43:21.491091 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.491095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.491146 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.491198 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.491870 (+ 672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37906: BlockingRecv error: recv got EOF from 127.0.0.1:37906 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 18:43:21.493731 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.489607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.4.61.253:40149)
0808 18:43:21.489721 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.489725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.492422 (+ 2697us) server_negotiation.cc:407] Connection header received
0808 18:43:21.492941 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.492945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.492999 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.493049 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.493608 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55458: BlockingRecv error: recv got EOF from 127.0.0.1:55458 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 18:43:21.494843 7434 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.490239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.4.61.252:36915)
0808 18:43:21.490387 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.490391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.492752 (+ 2361us) server_negotiation.cc:407] Connection header received
0808 18:43:21.494075 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.494079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.494129 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.494177 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.494706 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42696: BlockingRecv error: recv got EOF from 127.0.0.1:42696 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 18:43:21.499469 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.497893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55466 (local address 127.4.61.253:40149)
0808 18:43:21.498018 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.498021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.498508 (+ 487us) server_negotiation.cc:407] Connection header received
0808 18:43:21.498723 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.498726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.498809 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.498860 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.499367 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55466: BlockingRecv error: recv got EOF from 127.0.0.1:55466 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 18:43:21.504556 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.503092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55474 (local address 127.4.61.253:40149)
0808 18:43:21.503191 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.503195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.503694 (+ 499us) server_negotiation.cc:407] Connection header received
0808 18:43:21.503872 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.503875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.503925 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.503972 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.504453 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55474: BlockingRecv error: recv got EOF from 127.0.0.1:55474 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 18:43:21.510109 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.508669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.4.61.253:40149)
0808 18:43:21.508767 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.508771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.509238 (+ 467us) server_negotiation.cc:407] Connection header received
0808 18:43:21.509435 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.509438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.509488 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.509535 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.510008 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55476: BlockingRecv error: recv got EOF from 127.0.0.1:55476 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 18:43:21.517922 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.516370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55492 (local address 127.4.61.253:40149)
0808 18:43:21.516507 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.516512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.517014 (+ 502us) server_negotiation.cc:407] Connection header received
0808 18:43:21.517195 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.517199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.517250 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.517311 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.517810 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55492: BlockingRecv error: recv got EOF from 127.0.0.1:55492 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 18:43:21.529678 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.528146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55500 (local address 127.4.61.253:40149)
0808 18:43:21.528248 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.528252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.528757 (+ 505us) server_negotiation.cc:407] Connection header received
0808 18:43:21.528953 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.528957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.529008 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.529054 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.529569 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55500: BlockingRecv error: recv got EOF from 127.0.0.1:55500 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 18:43:21.551494 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.548528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55510 (local address 127.4.61.253:40149)
0808 18:43:21.548659 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.548664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.549306 (+ 642us) server_negotiation.cc:407] Connection header received
0808 18:43:21.550595 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.550599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.550663 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.550719 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.551364 (+ 645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55510: BlockingRecv error: recv got EOF from 127.0.0.1:55510 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 18:43:21.587642 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.586304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.4.61.253:40149)
0808 18:43:21.586452 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.586457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.586761 (+ 304us) server_negotiation.cc:407] Connection header received
0808 18:43:21.586893 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.586897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.586963 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.587052 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.587516 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55524: BlockingRecv error: recv got EOF from 127.0.0.1:55524 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 18:43:21.654667 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.653585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55534 (local address 127.4.61.253:40149)
0808 18:43:21.653730 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.653734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.653872 (+ 138us) server_negotiation.cc:407] Connection header received
0808 18:43:21.654006 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.654009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.654058 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.654142 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.654564 (+ 422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55534: BlockingRecv error: recv got EOF from 127.0.0.1:55534 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 18:43:21.785782 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:21.784728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.4.61.253:40149)
0808 18:43:21.784859 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:21.784863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:21.785007 (+ 144us) server_negotiation.cc:407] Connection header received
0808 18:43:21.785133 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:21.785136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:21.785186 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:21.785262 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:21.785681 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55536: BlockingRecv error: recv got EOF from 127.0.0.1:55536 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 18:43:22.045254 7311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 18:43:22.044145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55540 (local address 127.4.61.253:40149)
0808 18:43:22.044310 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.044313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.044403 (+ 90us) server_negotiation.cc:407] Connection header received
0808 18:43:22.044529 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.044532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.044582 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.044666 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 18:43:22.045141 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55540: BlockingRecv error: recv got EOF from 127.0.0.1:55540 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 18:43:22.393944 7504 catalog_manager.cc:1259] Loaded cluster ID: 5a81bd7b36fa427d95c10df4485c45a9
I20260808 18:43:22.394033 7504 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: loading cluster ID for follower catalog manager: success
I20260808 18:43:22.395793 7504 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: acquiring CA information for follower catalog manager: success
I20260808 18:43:22.396976 7504 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 58650e4f91bc4594b6e774b6a390c6b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:43:22.414295 7517 catalog_manager.cc:1574] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: acquiring CA information for follower catalog manager: success
I20260808 18:43:22.415670 7517 catalog_manager.cc:1602] T 00000000000000000000000000000000 P eb0dfa3a4d5f43cc895dfe19f3d97ef2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 18:43:22.563707 7640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:22.559490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55552 (local address 127.4.61.253:40149)
0808 18:43:22.559759 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.559763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.559781 (+ 18us) server_negotiation.cc:407] Connection header received
0808 18:43:22.559847 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.559850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.560040 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.560156 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:22.560404 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.561139 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.562283 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.562575 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.562663 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:22.562939 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:22.563397 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:22.563494 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:22.563523 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 18:43:22.563573 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":70,"threads_started":1}
I20260808 18:43:22.569943 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:22.566664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.4.61.252:36915)
0808 18:43:22.566901 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.566904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.566918 (+ 14us) server_negotiation.cc:407] Connection header received
0808 18:43:22.567045 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.567047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.567168 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.567268 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:22.567430 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.567925 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.568689 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.568932 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.569006 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:22.569234 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:22.569628 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:22.569713 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:22.569740 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 18:43:22.569793 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":82,"threads_started":1}
I20260808 18:43:22.576897 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:22.573523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.4.61.252:36915)
0808 18:43:22.573631 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.573636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.573776 (+ 140us) server_negotiation.cc:407] Connection header received
0808 18:43:22.573881 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.573884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.573930 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.573999 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:22.574213 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.574800 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.575757 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.576091 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.576177 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:22.576477 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:22.576555 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:22.576627 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:22.576725 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 18:43:22.576775 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 18:43:22.576993 7640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:22.572959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.4.61.253:40149)
0808 18:43:22.573090 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.573094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.573209 (+ 115us) server_negotiation.cc:407] Connection header received
0808 18:43:22.573309 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.573312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.573359 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.573417 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:22.573714 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.574438 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.575818 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.576081 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.576142 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:22.576507 (+ 365us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:22.576574 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:22.576633 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:22.576806 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 18:43:22.576861 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 18:43:22.577521 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 18:43:22.572664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37920 (local address 127.4.61.254:44217)
0808 18:43:22.573015 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0808 18:43:22.573019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 18:43:22.573034 (+ 15us) server_negotiation.cc:407] Connection header received
0808 18:43:22.573132 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 18:43:22.573135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 18:43:22.573309 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 18:43:22.573434 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 18:43:22.573657 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.574420 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.575810 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 18:43:22.576165 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 18:43:22.576248 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 18:43:22.576616 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 18:43:22.576991 (+ 375us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 18:43:22.577076 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 18:43:22.577286 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 18:43:22.577344 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":92,"threads_started":1}
I20260808 18:43:22.580582 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7079
I20260808 18:43:22.595469 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7193
I20260808 18:43:22.605458 4343 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYnvF7/build/debug/bin/kudu with pid 7317
2026-08-08T18:43:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3164 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6381 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290609 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST